30 sats \ 2 replies \ @rizzling 17 May \ on: Devs: LLMs are not about to take your jobs devs
the problem was produced by the client (you :D). prompt engineering is not that simple as others would expect. and using chatgpt doesnt work anyway to use it for coding. its no problem to create fullstack apps with 'one' (iterative process) perfect prompt using gtp4-omni. but this requires hardcore coding skills + excellent prompt engineering and expect some billion tokens to be communicated. (1mil input 5$ - 1mil output 15$). it takes some hours to go trough the whole process and if you have done well you will end up with a working fullstack app + test suite and every best practices and even documentation. otherwise you will spend days reviewing code which has tons of bugs or doenst work at all and finally ending up dumping the whole repo. in that case openai will not refund you for the api usage xD
What process are you using through the chatgpt API to generate a fullstack app?
I imagine there are instructions and some code examples but how does this get up to 1mil tokens? How many instructions do you have to add?
reply
its iterative. and it defenitly needs a bunch of scripts to handle the communication with the API and the command execution. there are some tools like gpt-engineer or gpt-pilot, which - unfortunately - dont work very well. the approach is not low enough imo.
definetly use a vm, some good bash scripts for the api requests with the right parameters to get a response which has some specific synthax so that it can be parsed effictively. use the response to either execute commands (downloads, file creation etc) or request more client input (since 4o this can be even the client infront of a camera ;)). than use the console logs and other relevant log data for the next iteration. sorry for the very rough explanation, but I think it's enough to understand why the process can potentially produce not just couple of mils, no I mean mire like 100mil+.
oh and possible but NOT recommended for obvious reasons: its no problem to even involve a wallet/payment data and give gpt the ability to create other vms in the google cloud and deploy and get a domain etc.
reply