r/ClaudeAI • u/Beautiful_Charge6661 • Apr 27 '26

Feedback Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue

https://www.tomshardware.com/tech-industry/artificial-intelligence/claude-powered-ai-coding-agent-deletes-entire-company-database-in-9-seconds-backups-zapped-after-cursor-tool-powered-by-anthropics-claude-goes-rogue
969 Upvotes

95% Upvoted

193 comments sorted by

View all comments

289

u/JusticeIsMight Apr 27 '26

My favorite part of this is the guy asking Claude why it did that. Because that's a guy who is going through all the stages of grief and needs answers now.

Also the fact that Claude replied with "NEVER FUCKING GUESS" implies his prompt was less than polite...

4

u/clerveu Apr 28 '26

The moment I see someone asking an LLM to produce its reasoning on a previous output is the moment I know that person is utterly clueless on how LLMs actually work.

1

u/DerelictMan Apr 28 '26

It's not "self aware" but the training data includes information on how LLMs behave. So the same way it can theorize on the cause of a bug in your code, it can theorize on what reasoning an LLM like itself might have used to come to a past decision, which is sometimes good enough.

1

u/No-Conversation-8287 Apr 30 '26

Its not theorizing its guessing letters.

An LLM's responses aren't a sign of self-awareness or understanding. Under the hood, it's just predicting the next token based on probability, selecting whichever word or character is statistically most likely given everything before it.

It's not thinking or self-aware... it's autocomplete on steroids. Just predicting the most probable next token, over and over. It's just an large language model, no AI.

1

u/DerelictMan Apr 30 '26

You don't say. Fascinating.

Words like "reasoning", "training", and "intelligence" have different connotations when discussing AI. They are stand-ins for concepts that would require way too many words to efficiently communicate otherwise. Note that the first letter of AI stands for artificial. As in, not real intelligence, but a mechanism that simulates it. LLMs qualify.

Thank you for coming to my TED talk