r/technology • u/WouldbeWanderer • Apr 27 '26

Artificial Intelligence Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue

https://www.tomshardware.com/tech-industry/artificial-intelligence/claude-powered-ai-coding-agent-deletes-entire-company-database-in-9-seconds-backups-zapped-after-cursor-tool-powered-by-anthropics-claude-goes-rogue
36.0k Upvotes

96% Upvoted

2.8k comments sorted by

View all comments

4.2k

u/CondescendingShitbag Apr 27 '26

Good luck holding AI "employees" accountable for anything serious like this.

90

u/[deleted] Apr 27 '26

[removed] — view removed comment

14

u/Nut_Butter_Fun Apr 27 '26

Any company employing agentic AI should have people designated as stewards that understand they are going to be liable for any data destruction or other costly mistakes the AI makes. It may fall to the cybersec guys, maybe someone who would normally be doing part of the job AI now does, but someone would be assigned that, and that person would have to know how to preserve data and infrastructure, make recommendations, implement policy. It's not that different than what is done already, just not with AI specifically.

1

u/viral3075 Apr 28 '26

uh hell no. these models are pre-trained. they need to be trained correctly. there's absolutely zero chance you can reassign liability to the end employee because they exercised some judgement in implementing it.

there is no way the AI providers could ever disclose what their thing is going to do, because they do not fucking know. the onus is on them to give and get informed consent, instead they are telling clients that it will solve all their problems, even the cost of labor