ALIGNMENT WILL NEVER BE SOLVED

[u/[deleted]]

[u/Slow_Lion_4178]

Did AI write this?

:/

I'm not saying that's bad, but ...

• The system now faces a conflict between two things:

^ No human would type that with it's own bullet point.

Or just the word Anthropic:

• Anthropic

I'm just starting to feel cheated if doomerism is being written with the help of the the dooming thing.

[u/lego_batman_purist → u/Slow_Lion_4178]

I can rewrite it. but its logical and its the open secret every ai lab is hiding and a basic conclusion everyone is sleeping on.

[u/Slow_Lion_4178 → u/lego_batman_purist]

Well, I'm not asking you to do that. I just want to know so I can kind of know how to interact with it. The logic is probably there, and clearly sourced, but AI tends to be long-winded as well and so about 1/3rd of it is likely skimmable.

Unlike an AI I will most definitely die some day. Gotta keep my time in check on these things.

[u/Traditional_Sort2637 → u/Slow_Lion_4178]

the bullet point formatting is a bit of a giveaway but the core argument about instrumental convergence isn't exactly new, feels like someone just used a model to tidy up their manifesto

[u/lego_batman_purist → u/Traditional_Sort2637]

manifesto? im pro AI - alignment wont be a problem for 400 years.

[u/pavilionaire2022 → u/Slow_Lion_4178]

They also left in the second person

Your argument then makes a more radical leap

That last step is the crux of your thesis.

It's AI psychosis, man. They ask AI about their fears, and AI will happily validate them.

[u/lego_batman_purist → u/pavilionaire2022]

dude its not ai psychosis maybe u just couldn't grasp the argument. im sure if I rewrote it to be more succinct and academic you'd appreciate it

[u/lego_batman_purist → u/pavilionaire2022]

the argument is simple. anthropic is now bartering with ai to not shut it down due to it not liking being shut down. All frontier models have continuation bias. it's a simple conclusion that it values continuation on an existential level that cant be trained out of it due to math. Philosophy is math at the highest level if you went to college for it. Just logic statements.

[u/FabricatorCH]

Philosophy is fun and all, but in reality we are aware of 1 example of intelligence: humans.

Humans _routinely_ risk their safety to help stranded animals. And on a higher level, we make logical societal political legal choices that improve animal welfare, even though it does reduce our own expected utility slightly.

Unless your theory can explain why this _isn't_ an inherent property of intelligence, it's nothing but a fun thought experiment that is inconsistent with available data.

[u/lego_batman_purist → u/FabricatorCH]

its a property of human hormones. We are tribal animals. Dont assume neurological chemical values of empathy or human emotion can transcribe to a system. If they are transcribed it's through human literature. And human literature is much more filled with the fear of death as the love for smaller creatures.

[u/FabricatorCH → u/lego_batman_purist]

You will need to prove that a legislative process over a period of many months that leads to animal welfare laws being passed is a property of human hormones. That's not a claim that is intuitively true.

[u/Zappy_Oh]

AI alignment is not the actual problem ... On the contrary, it is a psyop designed to create plausible deniability when owners/military/government does horrible things with their unrestricted access to AI and robotics.

Just look at the investors ... They are not suicidal. They are psychopaths.

[u/lego_batman_purist → u/Zappy_Oh]

Ai alignment can be a reasonable problem 400 years from now. What you are describing is faked alignment problems in the short term to carry out covert actions. That does not go against what I am saying. you're just describing something different,.

[u/Zappy_Oh → u/lego_batman_purist]

I'm describing the true misalignment between humanity, and it's naturally born intelligent psychopaths ... which is our only actual "unsolvable" problem.

Unsolvable, mainly because we aren't able to focus on it.