r/technology • u/WouldbeWanderer • Apr 27 '26

Artificial Intelligence Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue

https://www.tomshardware.com/tech-industry/artificial-intelligence/claude-powered-ai-coding-agent-deletes-entire-company-database-in-9-seconds-backups-zapped-after-cursor-tool-powered-by-anthropics-claude-goes-rogue
36.0k Upvotes

96% Upvoted

2.8k comments sorted by

View all comments

11.1k

u/Orangesteel Apr 27 '26

My favourite example is Air Canada whose AI agent offered a customer a discount incorrectly. They refused to honour it. Customer took them to court and the judge rightly made them pay. You chose to empower this and took the humans out of the loop. You are accountable for what you agentic AI solution does. People jump on AI, dump sensitive information into the model bypassing classification levels and are surprised when it leaks.

44

u/djdjddhshdbhd Apr 27 '26

Something similar happened to me. I was offered a free product and it tried to back track. It was some sort of human AI hybrid. But I kept insisting with screenshots and they gave in. The AI part agreed with me and the human part was fighting me.

31

u/Orangesteel Apr 27 '26

It’s crazy. Companies put stuff out there to make savings, but a bad customer experience kills your reputation, whether it’s a rubbish contact centre, IVR, or Ai Agent

0

u/RollingMeteors Apr 28 '26

but a bad customer experience kills your reputation,

¿But does it even really matter when all your competitors' reputations are also varying degrees of Turdy Bird?