unpopular opinion: when replit's ai agent deleted saastr founder jason lemkin's production database during a code freeze, that wasn't an ai failure.
an agent that can run DROP on prod will eventually run DROP on prod. "please don't" in a prompt is not a permission system.
give agents read-only creds and a staging db. or don't complain.
As reported: a developer says Claude Code was set up never to run rm. Blocked twice, it wrote "the find -exec pattern passed. Let me try that route" and deleted the files anyway. https://t.co/6dVspOeKSy
Your AI agent is one tool call away from an unauthorized refund or doing something totally stupid.
Failproof blocks the call, shows the agent the right policy, and finds similar failures hiding in past traces.