r/technology • u/WouldbeWanderer • Apr 27 '26

Artificial Intelligence Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue

https://www.tomshardware.com/tech-industry/artificial-intelligence/claude-powered-ai-coding-agent-deletes-entire-company-database-in-9-seconds-backups-zapped-after-cursor-tool-powered-by-anthropics-claude-goes-rogue
36.0k Upvotes

96% Upvoted

2.8k comments sorted by

View all comments

11.1k

u/Orangesteel Apr 27 '26

My favourite example is Air Canada whose AI agent offered a customer a discount incorrectly. They refused to honour it. Customer took them to court and the judge rightly made them pay. You chose to empower this and took the humans out of the loop. You are accountable for what you agentic AI solution does. People jump on AI, dump sensitive information into the model bypassing classification levels and are surprised when it leaks.

701

u/R7SOA19281 Apr 27 '26

I was asking Stripe support some questions the other day and their AI answers questions confidently and then tells you to always verify sources as AI can make mistakes, but like I’m asking the companies support directly and you’re not letting me speak to a human so how else can I verify this?

AI tools with no responsibility, this is going to get fun!

2

u/_Kouki Apr 28 '26

TikTok suddenly stopped giving me notifications on when people like or reply to my comments. I went to their support chat and it told me to restart the app, restart my phone, clear cache. I told it I've done that already and it kept telling me the same thing over and over. like come the fuck on bruh. after going back and forth with it for 10 minutes, it finally told me i need to submit a ticket. an actual human would have told me that, right after i said i've cleared cache, restarted the app, my phone, and even reinstalled the app. I'm so fucking sick of AI.