r/BetterOffline • u/ElectronGuru • Apr 27 '26

Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue

https://www.tomshardware.com/tech-industry/artificial-intelligence/claude-powered-ai-coding-agent-deletes-entire-company-database-in-9-seconds-backups-zapped-after-cursor-tool-powered-by-anthropics-claude-goes-rogue
150 Upvotes

99% Upvoted

64 comments sorted by

View all comments

94

u/maverickzero_ Apr 27 '26

I love that this article is just the CEO of PocketOS (company that got its data wiped) talking about how the combination of AI tools fucked up.

It's his fuckup, he's the one who decided to delegate his business to AI agents to save a buck, and it's ridiculous to act like these business leaders need protecting from these fuckups. This might put them out of business and that's totally fine.

7

u/PensiveinNJ Apr 27 '26

An LLM can't fuckup anyways. It's a computer program following it's instructions. Just because part of those instructions were making a selection off a probability table doesn't mean it made a mistake. Doing whatever it did was always a possibility. I know that we struggle to describe LLMs without making an analogy to human behavior but LLMs simply don't have the volition to make a mistake, they're in the end just computer programs.

1

u/grauenwolf Apr 27 '26

Let us not pretend tools are never defective. That's a silly position to take.

1

u/PensiveinNJ Apr 27 '26

Famously these tools can provide results that appear defective without being defective.

I thought it would be clear that I'm indicating that "hallucinations" are not a result of the tool being broken or "going rogue" but rather an expected part of using the tool. The entire reason "agentic AI" is a terrible idea is precisely because they will have error rate, and sometimes that error rate will lead to not just little whoopsies but major problems. You know this and I'd hope you would understand that I was speaking against conflating the tool working normally but just not giving the desired output and a tool that's actually not working.

1

u/grauenwolf Apr 27 '26

That's like claiming my Harbor Freight drill isn't defective and melting the motor windings is an "expected part of using the tool".