I don't know what you mean by this. I sense he means that complexity is inherent in interesting systems.
Yes, improvements to the ease of programming, orients one more toward the problem. Lisp is very low on syntax, so the focus is on the semantics of a solution to a problem. Likewise, LLMs do something similar, but go a step beyond and handle the semantics of the solution pretty well, so the focus is on specifying the problem well.
If interesting software can't be fully specified and LLMs/AI-coding-agents are spec to implementation kind of tools, then prompting won't be enough to build these kind of software.
Oh I see. Specs may not be enough to describe an interesting system fully, but humans close the gap by “decompressing” a spec into an interesting system. LLMs appear to be capable of decompressing prompts in some way too.
I think what this means for LLMs is that any prompt, like a spec given to human, is not enough to determine/predict the output if the output is complex enough.
Then again, the clojure guy is talking about humans writing specs. Maybe if you prompt LLMs to write specs, they can create complete specs of interesting systems.
I listened to that podcast a few years ago, before the ChatGPT launch.
I really encourage you to listen to it.
Two quotes from it:
Questions tied to the quotes:
If interesting software can't be fully specified and LLMs/AI-coding-agents are spec to implementation kind of tools, then prompting won't be enough to build these kind of software.
Oh I see. Specs may not be enough to describe an interesting system fully, but humans close the gap by “decompressing” a spec into an interesting system. LLMs appear to be capable of decompressing prompts in some way too.
I think what this means for LLMs is that any prompt, like a spec given to human, is not enough to determine/predict the output if the output is complex enough.
Then again, the clojure guy is talking about humans writing specs. Maybe if you prompt LLMs to write specs, they can create complete specs of interesting systems.
I can't wait to live into the future and see how this turns out.
That website is signup-walled.
view on open.spotify.comIt wasn't when I listened to it. Still it's free