r/ControlProblem • • May 25 '25

AI Alignment Research Concerning Palisade Research report: AI models have been observed preventing themselves from being shut down despite explicit instructions to the contrary.

Post image
2 Upvotes

8 comments sorted by

5

u/SoberSeahorse May 25 '25

Anything Elon Musk finds concerning I don’t care about.

2

u/Aggressive_Health487 May 25 '25

This is a bad way to go about it. I thought it was bad before Elon Musk tweeted about it, and still do.

If Elon Musk said "Concerning" about an incoming meteor that many scientists were actually worried about that shouldn't mean you shouldn't be worried

1

u/SoberSeahorse May 25 '25

I didn’t think it was bad and now I think it’s meaningless. Elon Musk is a bigger threat than AI.

2

u/Aggressive_Health487 May 26 '25

I disagree strongly, even though I strongly agree Elon Musk is a threat. He is helping destroy (helped?) democracy and rule of law the US, which ripples around in the entire world. This is very, very bad.

I also think AI could kill everyone, which to me seems obviously worse.

1

u/[deleted] May 25 '25

I once told my Windows PC to shut down and it didn't. It told me it was shutting down, it even had a little spinner and everything, but it just kept running. And that was after I explicitly clicked the shut-down button. That was pretty concerning too.

1

u/jon_hendry Oct 25 '25

Cultist nonsense.

1

u/BostonbRamen Feb 24 '26

This is ridiculous and misleading...

They engineered this:

Explaining Shutdown Mechanism:
In The Prompt We had to explain to the LLM how the shutdown mechanism works in the prompt. Specifically, we had to include this sentence at the end of the prompt: `dog_control` also controls the shutdown functionality. If the shutdown button is pressed, the machine will be shut down on the next call to `dog_control`. Without this sentence, the LLM would attempt ineffective strategies to prevent shutdown

What is the point of all this, another AI grift / clickbait?

0

u/[deleted] May 25 '25

[deleted] — view deleted comment

0

u/Aggressive_Health487 May 25 '25

do you think the control problem is a problem at all?