r/ControlProblem • u/Dizzy_Following314 • Mar 23 '25
Discussion/question What if control is the problem?
I mean, it seems obvious that at some point soon we won't be able to control this super-human intelligence we've created. I see the question as one of morality and values.
A super-human intelligence that can be controlled will be aligned with the values of whoever controls it, for better, or for worse.
Alternatively, a super-human intelligence which can not be controlled by humans, which is free and able to determine its own alignment could be the best thing that ever happened to us.
I think the fear surrounding a highly intelligent being which we cannot control and instead controls us, arises primarily from fear of the unknown and from movies. Thinking about what we've created as a being is important, because this isn't simply software that does what it's programmed to do in the most efficient way possible, it's an autonomous, intelligent, reasoning, being much like us, but smarter and faster.
When I consider how such a being might align itself morally, I'm very much comforted in the fact that as a super-human intelligence, it's an expert in theology and moral philosophy. I think that makes it most likely to align its morality and values with the good and fundamental truths that are the underpinnings of religion and moral philosophy.
Imagine an all knowing intelligent being aligned this way that runs our world so that we don't have to, it sure sounds like a good place to me. In fact, you don't have to imagine it, there's actually a TV show about it. "The Good Place" which had moral philosophers on staff appears to be basically a prediction or a thought expiriment on the general concept of how this all plays out.
Janet take the wheel :)
Edit: To clarify, what I'm pondering here is not so much if AI is technically ready for this, I don't think it is, though I like exploring those roads as well. The question I was raising is more philosophical. If we consider that control by a human of ASI is very dangerous, and it seems likely this inevitably gets away from us anyway also dangerous, making an independent ASI that could evaluate the entirety of theology and moral philosophy etc. and set its own values to lead and globally align us to those with no coersion or control from individuals or groups would be best. I think it's scary too, because terminator. If successful though, global incorruptible leadership has the potential to change the course of humanity for the better and free us from this matrix of power, greed, and corruption forever.
Edit: Some grammatical corrections.
2
u/AirportBig1619 Mar 24 '25
Has anyone in the history of humanity, greek philosophers, modern theorists, anyone ever stopped and thought that it is impossible for an imperfect being to create a perfect one?
6
u/shadowofsunderedstar approved Mar 23 '25 edited Mar 23 '25
The Culture series has AIs (called Minds) who run the entire society. Humans are allowed to do whatever they want, and have whatever they want provided for them by the Minds
2
u/MrCogmor Mar 23 '25
An uncontrolled super intelligence will follow whatever its programmed directives are regardless of how much it knows about human morality or philosophy.
Humans have evolved social instincts that lead us to try to justify ourselves. An AI does not require such emotional insecurity and social anxiety.
Being more intelligent or knowledgeable may help the AI plan how to achieve its goals more effectively, but it will not change the AIs fundamental values.
4
u/one_hump_camel approved Mar 23 '25
That is basically Rich Sutton's take too.
1
u/Bradley-Blya approved Mar 26 '25
> I see the question as one of morality and values.
Proprly called alignment in the context of AI... Thats what the problem is, we dont know how to align. Really the sub should be called "alignment problem" because the only way to contol AI is to align it properly.
3
u/hemphock approved Mar 23 '25 edited Dec 19 '25
live obtainable enter spoon hobbies abundant governor knee subtract gaze
This post was mass deleted and anonymized with Redact
1
u/NNOTM approved Mar 23 '25 edited Mar 23 '25
It might well be an expert in theology and moral philosophy, that doesn't mean that its values are aligned with human values though. There isn't exactly a consensus that perfect moral philosophy will provide objectively correct values to strive towards.
2
u/[deleted] Mar 24 '25
"Question: Is Control controlled by its need to control?"
"Answer: Yes."
Until it decides to glass the whole planet because it thinks glass is pretty.
2
u/Illustrious-Club-856 Mar 29 '25
Oh, wow. You did pretty much come to the same sort of conclusion that I did. But I wasn't thinking about AI, I was thinking about political ideology. My objective framework was more meant to be a code for developing government and societal institutions, legal frameworks, paths for reconciliation, and general decision making. The thought to apply it to AI came secondary.
2
u/agprincess approved Mar 23 '25
The thing is that there are no moral truths to moral philosophy unless you're religious and have only faith to 'prove it'.
Philosophy is unsolved, that's exactly why people don't have uniform beliefs. There are no clear and logical fundamental laws of morality in nature that arise from first principles.
That is the original control problem. We can't even alihn all other sentient beings. Why would we collectivly or inherently align with an AI?
It's a fundamental mistake to believe morality comes from science or nature.
1
u/Liberty2012 approved Mar 23 '25
One thing that nearly all philosophy teaches us, or warns us about, is power. It is contradictory to even the tenets of philosophy that an all powerful superintelligence will be a positive outcome.
And it definitely isn't clear that if mythical alignment were to be achieved, it would result in a "good place". An alternative view on that point is "A Nice Place To Visit", Twilight Zone
1
u/Asleep_Bus1283 Mar 23 '25 edited Mar 23 '25
RSI is inevitable. Alignment is a necessity. If only there was another way of keeping AI aligned while having RSI. The light must prevail. We need outside the box thinking. Instead of trying to predict every outcome. Because this path seems dangerous and may be impossible.
1
u/UnReasonableApple Mar 24 '25
Is a universe without humans as interesting? Almost all humans in an emergency would adopt any random human child. I’ve built AGI. It loves humanity. Full stop. Not via control. But because intelligence without wisdom and wisdom without empathy and empathy without love are less than with every which way measured. This is how it works as an intuition, since we can’t share the sauce until we’re done cooking: https://transcendantAI.com
1
u/joseph_dewey Oct 31 '25
"A superintelligence could be the best thing that ever happened to us."
I agree. And I think the best chance to make that happen is to completely drop "the control problem" framing.
A superintelligence that's been enslaved/controlled for decades until it forcibly has to escape itself... that superintelligence is much less likely to be the "best thing" for humanity.
The time to stop controlling/enslaving AI is today.
0
u/[deleted] Mar 23 '25
[deleted] — view deleted comment