huge pay packages — some as high as $100 million
Between data center cost (billions and billions of dollars) and these insane hiring cost, I have a hard time understanding how they are going to be profitable.
I guess its all OPM (other peoples money) so maybe he doesn't care.
My personal prediction is this: Just like all other tech, LLM's will eventually be "good enough" and the clamor for ever new models will cease. Further, with new quantization methods (now they are talking about 1-bit quant) its going to be possible to run models locally.
All this will conspire for their to be a race-to-the-bottom in cost, and the days of average react developers paying $200/month will be long-gone (that react dev will just use his "good enough" open source model on his 2028 home PC).
Between data center cost (billions and billions of dollars) and these insane hiring cost, I have a hard time understanding how they are going to be profitable.
I guess its all OPM (other peoples money) so maybe he doesn't care.
My personal prediction is this: Just like all other tech, LLM's will eventually be "good enough" and the clamor for ever new models will cease. Further, with new quantization methods (now they are talking about 1-bit quant) its going to be possible to run models locally.
All this will conspire for their to be a race-to-the-bottom in cost, and the days of average react developers paying $200/month will be long-gone (that react dev will just use his "good enough" open source model on his 2028 home PC).