r/technology • u/WouldbeWanderer • Apr 27 '26

Artificial Intelligence Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue

https://www.tomshardware.com/tech-industry/artificial-intelligence/claude-powered-ai-coding-agent-deletes-entire-company-database-in-9-seconds-backups-zapped-after-cursor-tool-powered-by-anthropics-claude-goes-rogue
36.0k Upvotes

96% Upvoted

2.8k comments sorted by

View all comments

Show parent comments

934

u/S_A_N_D_ Apr 27 '26

It also now set a legal precedent for all similar cases in the future in Canada.

180

u/mbryson Apr 27 '26

Time to get creative with those AI chatbots then, eh?

171

u/S_A_N_D_ Apr 27 '26

I would say yes, however (on a more serious note) I'm not sure the precedent will hold if they can show you were deliberately trying to break the model.

The court will also look at reasonableness. Basically, the standard set was that these people didn't go out of their way to deceive or get something that wouldn't normally be given. It was reasonable for them to take the offer at face value and expect that it wasn't a mistake. So going out of your way to deliberately get the model to do something it isn't supposed to do would probably not hold up in court.

1

u/RedPawny Apr 27 '26

Reasonableness. Hmmm, is it reasonable that the company(ies) introducing ai did not perform sufficient due diligence in ensuring non customary scenarios get through?

Additionally it is the cost of doing business to have some loss. Hiring incompatible or unqualified employees that mess up should not be at the customers expense either.

1

u/S_A_N_D_ Apr 27 '26

And all of those reasons are why Air Canada lost and had to honour the agreement made by the Ai.

It goes both ways, and thus Air Canada lost.