Between data center cost (billions and billions of dollars) and these insane hiring cost, I have a hard time understanding how they are going to be profitable.

I guess its all OPM (other peoples money) so maybe he doesn't care.

My personal prediction is this: Just like all other tech, LLM's will eventually be "good enough" and the clamor for ever new models will cease. Further, with new quantization methods (now they are talking about 1-bit quant) its going to be possible to run models locally.

All this will conspire for their to be a race-to-the-bottom in cost, and the days of average react developers paying $200/month will be long-gone (that react dev will just use his "good enough" open source model on his 2028 home PC).