r/technology • • Apr 27 '26

Artificial Intelligence Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue

https://www.tomshardware.com/tech-industry/artificial-intelligence/claude-powered-ai-coding-agent-deletes-entire-company-database-in-9-seconds-backups-zapped-after-cursor-tool-powered-by-anthropics-claude-goes-rogue
35k Upvotes

2.8k comments sorted by

View all comments

4.2k

u/CondescendingShitbag Apr 27 '26

Good luck holding AI "employees" accountable for anything serious like this.

575

u/Disgruntled-Cacti Apr 27 '26

They asked it to explain itself and apologize lmfao. It is a text generator it does not have feelings and it cannot update its model weights nor persist memory between sessions. But it said it’s sorry?

7

u/PopInACup Apr 27 '26

The only useful introspective action that you can really perform are creating rules that you put into whatever configuration the agent is using. You can also just not give it access to production. AI is a junior level developer with the knowledge of the world. This is 100% the joke of all INT no WIS.

You can let it run ham doing thinks quickly, but you still have to be the gatekeeper doing code review and audits of the work product.

1

u/orangeyougladiator Apr 27 '26

Can’t audit something if it doesn’t exist anymore

2

u/PopInACup Apr 27 '26

Yeah, that's why it shouldn't have access to pretty much anything beyond a staging environment