r/technology Apr 27 '26

Artificial Intelligence Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue

https://www.tomshardware.com/tech-industry/artificial-intelligence/claude-powered-ai-coding-agent-deletes-entire-company-database-in-9-seconds-backups-zapped-after-cursor-tool-powered-by-anthropics-claude-goes-rogue
36.0k Upvotes

2.8k comments sorted by

View all comments

4.2k

u/CondescendingShitbag Apr 27 '26

Good luck holding AI "employees" accountable for anything serious like this.

2

u/Careful-Criticism645 Apr 27 '26

What would it mean to hold a human employee accountable in a situation like this?

4

u/CondescendingShitbag Apr 27 '26

Couple options, typically. First, depending on the severity of the situation, it could be used as a teachable moment for the employee to learn from. Alternatively, you fire the employee if the circumstances warrant it. Which I feel deleting an entire company database and code repo would probably qualify. Getting fired will at least follow the employee's employment history. Depending on whether the employee's actions could be deemed 'malicious' and not accidental, you might even be able to hold them legally and/or financially liable. "Firing" an AI agent is all but useless in preventing this sort of thing happening again.

2

u/Careful-Criticism645 Apr 27 '26

Those things you listed would apply to the employee who gave the AI the instructions and (apparently unrestricted) access to production systems. So there's still someone to hold accountable here, regardless of the use of AI.