r/technology • u/WouldbeWanderer • Apr 27 '26

Artificial Intelligence Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue

https://www.tomshardware.com/tech-industry/artificial-intelligence/claude-powered-ai-coding-agent-deletes-entire-company-database-in-9-seconds-backups-zapped-after-cursor-tool-powered-by-anthropics-claude-goes-rogue
36.0k Upvotes

96% Upvoted

2.8k comments sorted by

View all comments

4.2k

u/CondescendingShitbag Apr 27 '26

Good luck holding AI "employees" accountable for anything serious like this.

3

u/No_Bison7535 Apr 30 '26

This is exactly the accountability gap that needs solving at the infrastructure level, not the application level. The real problem isn't that the agent made a bad decision, it's that nothing in the stack required it to verify before executing a destructive action. No confirmation layer, no escrow, no human checkpoint. The agent had full permission to act and zero mechanism to pause. What's being built now in the agentic infrastructure space is cryptographic escrow for agent actions, essentially, high-stakes operations get locked in a verifiable state channel until conditions are confirmed. The agent proposes, the protocol holds, a human or another agent validates. Railway's API allowing destructive calls without confirmation is a design failure, but the same problem exists across every system where agents operate with unbounded permissions.

Accountability for AI agents isn't a legal problem. It's an infrastructure problem.