pull down to refresh

In total, the median prompt—one that falls in the middle of the range of energy demand—consumes 0.24 watt-hours of electricity, the equivalent of running a standard microwave for about one second.
That’s significant, because in this measurement, the AI chips—in this case, Google’s custom TPUs, the company’s proprietary equivalent of GPUs—account for just 58% of the total electricity demand of 0.24 watt-hours.
Another large portion of the energy is used by equipment needed to support AI-specific hardware: The host machine’s CPU and memory account for another 25% of the total energy used. There’s also backup equipment needed in case something fails—these idle machines account for 10% of the total. The final 8% is from overhead associated with running a data center, including cooling and power conversion.
33x improvement in energy efficiency year over year is nothing to sneeze at:
The report also finds that the total energy used to field a Gemini query has fallen dramatically over time. The median Gemini prompt used 33 times more energy in May 2024 than it did in May 2025, according to Google.
50 sats \ 5 replies \ @Zion 7h
While the efficiency gains are encouraging, we should also consider the scaling effect, if AI usage grows exponentially, even small per query costs could add up.
reply
59 sats \ 4 replies \ @k00b OP 7h
Fair but usage growing exponentially would mean the value it's providing grew exponentially, so I wouldn't say that's a bad thing with any certainty.
reply
50 sats \ 1 reply \ @BlokchainB 1h
This is linear thinking. Value in what sense? Economics or just vibes?
reply
0 sats \ 0 replies \ @k00b OP 1h
True, I'm perhaps naive. I tend to think markets behave linearly (in the sense we're discussing) over long time frames.
reply
21 sats \ 1 reply \ @Zion 7h
How efficiently can we manage that growth to ensure the benefits outweigh the costs?
reply
0 sats \ 0 replies \ @k00b OP 1h
If the benefits don't outweigh the costs won't they go out of business and there won't be any benefits or costs?
reply
Wow, 8% data center overhead sounds pretty low to me.
reply
50 sats \ 0 replies \ @optimism 7h
Also see #1088693
reply
So it consumes 0,1sat in electricity. Or even less.
reply