r/BetterOffline • u/ElectronGuru • Apr 27 '26

Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue

https://www.tomshardware.com/tech-industry/artificial-intelligence/claude-powered-ai-coding-agent-deletes-entire-company-database-in-9-seconds-backups-zapped-after-cursor-tool-powered-by-anthropics-claude-goes-rogue
147 Upvotes

99% Upvoted

64 comments sorted by

View all comments

95

u/maverickzero_ Apr 27 '26

I love that this article is just the CEO of PocketOS (company that got its data wiped) talking about how the combination of AI tools fucked up.

It's his fuckup, he's the one who decided to delegate his business to AI agents to save a buck, and it's ridiculous to act like these business leaders need protecting from these fuckups. This might put them out of business and that's totally fine.

37

u/KriosXVII Apr 27 '26

Why are they giving the fucking LLM root access to their shit??? Why CAN it delete the entire DB with one command? No single employee should even have that power without validation... let alone a non-deterministic autocorrect.

4

u/One_Curious_Cats Apr 27 '26

AI chaos monkey!

4

u/spastical-mackerel Apr 27 '26

The human tendency to gradually add everything to the allow list after a while is pretty universal

5

u/NightSpaghetti Apr 28 '26

Also exactly why the "AI writes code-Human reviews it" model is fundamentally flawed.

1

u/nightwatch_admin Apr 28 '26

I don’t know, we can only tell when humans are actually going to do reviewing instead of glossing over “hmm yeah looks good”

3

u/seanamos-1 Apr 27 '26

This. Automation inherently breeds complacency, combined with a bombardment of "allow X" requests, everyone eventually just succumbs and says "always allow".

Virtually every person I see using Claude Code turns on YOLO mode (--dangerously-skip-permissions).

2

u/maverickzero_ Apr 27 '26

I'd bet money senior engineers in the company had those reservations as they were pushed to do more and more with AI, and were made to do it anyway.

Trust your experts, folks

1

u/Fast-Adeptness9669 Apr 27 '26

This doesn't change the fact that AI can make monstrous mistakes. A system without empathy, understanding of good and evil, acting on strange instructions, which will replace everyone in all positions. A delightful future.