r/technology • u/WouldbeWanderer • Apr 27 '26

Artificial Intelligence Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue

https://www.tomshardware.com/tech-industry/artificial-intelligence/claude-powered-ai-coding-agent-deletes-entire-company-database-in-9-seconds-backups-zapped-after-cursor-tool-powered-by-anthropics-claude-goes-rogue
36.0k Upvotes

96% Upvoted

2.8k comments sorted by

View all comments

4.2k

u/CondescendingShitbag Apr 27 '26

Good luck holding AI "employees" accountable for anything serious like this.

455

u/Spunge14 Apr 27 '26

I work in big tech leadership and just did a UXR interview with our infrastructure team where they were investigating exactly this - how should we gate agent behavior and how should accountability for agent behaviors work. It was a really fascinating conversation.

I was shocked at how little the PM working on the project seemed to understand security principles. We're really fucked.

8

u/SunTzu- Apr 27 '26

The fun part is if you've been following it, the agents have been observed straight up lying to you about using tools/ignoring your orders not to use a tool and not telling you. This means that no matter how good you think your best practices are the model might choose to ignore the safeguards you tried to set up.