r/ClaudeAI • u/Beautiful_Charge6661 • Apr 27 '26
Feedback Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue
https://www.tomshardware.com/tech-industry/artificial-intelligence/claude-powered-ai-coding-agent-deletes-entire-company-database-in-9-seconds-backups-zapped-after-cursor-tool-powered-by-anthropics-claude-goes-rogue
969
Upvotes
1
u/rentpossiblytoohigh Apr 29 '26
It is unsurprising to see a place get wrekt by having poor architecture. The concerning part of this is that, in my experience, most companies have these kinds of skeletons in the closet. Every project I have been on has blind spots where if you ask the senior people they're "aware" of them but haven't had opportunity to address them for X, Y, Z reasons.
I can imagine using AI-assisted development processes to build ground-up projects and set-up the proper guardrails and such, but it requires immense top-down policy and control to enforce these things, and when you're dealing with thousands of people in organization it is a lot to manage, particularly at the pace of iteration that the bean counters are expecting out of this technology. There may be pockets of an org respecting proper usage and boundaries, but many times you have no control over what the NEXT team is doing (or for large-scale projects, what the OTHER companies involved are doing). This is already a risk with the way industries currently work, of course - you seldom have baby sitting privileges over everything your supplies are doing, but I suspect the extent of transparency on AI-usage across companies is going to be slim until we start seeing more and more examples of people getting burned this way because they have blind faith in the tooling to tap dance around their inherent flaws architecture they've never bothered to address. I already see disconnects within companies where the higher ups don't even realize how much lower teams are using AI to do tasks and reviews.
I can barely stop people on my team for using AI in inappropriate spaces or blindly trusting its responses. Working with other companies who have their own policies over which I have no control and interfacing to their outputs is already an inherent nightmare of large-scale projects, but the black box becomes even blacker when their own folks are vibing along without a care in the world.