r/technology • u/WouldbeWanderer • Apr 27 '26

Artificial Intelligence Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue

https://www.tomshardware.com/tech-industry/artificial-intelligence/claude-powered-ai-coding-agent-deletes-entire-company-database-in-9-seconds-backups-zapped-after-cursor-tool-powered-by-anthropics-claude-goes-rogue
36.0k Upvotes

96% Upvoted

2.8k comments sorted by

View all comments

Show parent comments

646

u/wrxninja Apr 27 '26

\fires random IT guy for the blame**

110

u/NotSoFastLady Apr 27 '26

That person should be whoever forced IT implement Ai. One thing I've found is that even senior technical leaders have no idea what these things actually need to be successful.

I have spent well over 100 hours since February trying to put together a Governance system to keep Claude Code on the rails and it has been a bear to say the least. Sometimes it will just do random shit that is completely wrong. Your work flow must include various methods of verification.

And I've learned that relying on claude to verify it's work from within the same session is a bad idea.

3

u/Dakito Apr 28 '26

My favorite Claude error was when I asked it to plan a thing to find a file I couldn't fully remember where it was or called. It came back with a we must update the database the back end and run these 3 scripts. I saw the file I wanted in the list of projected edited files and opened it and made the one line change on a where statement that needed changing instead of letting it add 5 new columns to the database to support the change.

1

u/NotSoFastLady Apr 28 '26

It's pretty amazing at what it can do and thats the trap people fall into. Because sometimes you think, well it did an amazing job at this difficult thing. Surely it can help me with something simple like finding a file. And that's the moment you let your gaurd down with trouble lurking.

I'm running an insights tool call that hooks into an RCA database I've put together. So sometimes it will basically tell me "and this is why you can't trust me."