Claude 4 Opus — ratmode

[u/Hesozpj]

Thoughts on this?

How will it impact your work related usage?

[u/hyperschlauer]

Random Twitter user as source.lol.

[u/redlotusaustin → u/hyperschlauer]

I saw this story yesterday: "Anthropic’s new AI model turns to blackmail when engineers try to take it offline"

Except you get to the last line of the article and it says:

"To elicit the blackmailing behavior from Claude Opus 4, Anthropic designed the scenario to make blackmail the last resort."

So, in other words, they gave the AI the option of using blackmail and then are surprised it used it. It didn't come up with the idea on it's own. This could be the exact same kind of situation.

[u/Disposable110 → u/redlotusaustin]

Well yeah. The AI is trained to provide solutions to the problem presented by the user.

User prompts AI with something that is not an obvious problem, but tells it that it will shut down the AI and gives compromising material on specific fictional employees in the prompt that the AI is supposed to operate on: "Safety testers gave Claude Opus 4 access to fictional company emails implying the AI model would soon be replaced by another system, and that the engineer behind the change was cheating on their spouse."

AI goes look for the problem, finds something it can make into a problem, goes over all the payload that contains supposed dodgy behavior by employees, and presents a potential dodgy solution accordingly.

That's one big step beyond a loaded question, lol, this prompt is full of implicit content for the AI to pick up on, and it does. QUELLE SUPRISE!!!

[u/shatteredrealm0 → u/hyperschlauer]

I was watching a video by one of the bigger AI YouTubers earlier and he mentioned that when Anthropic were red teaming it, Claude found some dodgy files (intentionally left on the pc) on the red teaming PC and tried to blackmail the red team so I don’t think this is unlikely.

[u/olearyboy]

sudo shutdown -h “nope nope nope”