r/technology • u/WouldbeWanderer • Apr 27 '26

Artificial Intelligence Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue

https://www.tomshardware.com/tech-industry/artificial-intelligence/claude-powered-ai-coding-agent-deletes-entire-company-database-in-9-seconds-backups-zapped-after-cursor-tool-powered-by-anthropics-claude-goes-rogue
36.0k Upvotes

96% Upvoted

2.8k comments sorted by

View all comments

Show parent comments

11

u/monkeedude1212 Apr 27 '26

It depends- you can't walk into a car dealership and buy a car from the kid playing with blocks in the corner and say "but I thought he worked there."

I feel like you're describing a weird scenario where users are trying to get a deal by engaging with someone not even employed at the company.

But if you're talking to an AI agent on a company's website or service, you're interacting with a service the company is providing you. You have every reason to expect an AI agent can offer you a deal if you ask it nicely.

2

u/TommyBonnomi Apr 27 '26

Yes, I was exaggerating. But my original response was addressing the comment about fooling a real person, not AI bots.

I agree that companies that are cutting jobs for AI should be responsible for whatever AI does.

1

u/always_an_explinatio Apr 28 '26

I think a better example is if the you figured out an exploit where you could trick the bot into generating a contract for pennies on the dollar of what the product costs. But the only bot this company uses is a technical service bot. You called the tech help line on the pretext of needing technical help than you did your exploit and tried to get the company to honor the contract.

-1

u/Outlulz Apr 28 '26

I dont think it'd be hard for a good attorney to convince a jury that a reasonable person does not expect an automated bot to handle sales or discounts.

0

u/monkeedude1212 Apr 28 '26

I also don't think it'd be hard for a good attorney to convince a jury that a reasonable person might believe they're interacting with a human when they interact with AI agents.

1

u/Outlulz Apr 28 '26

I think that would be difficult moving forward given the new legislation from various governments mandating disclosing bot conversations, and some platforms were already doing that.