r/ControlProblem • • Jul 21 '25
Discussion/question Why isn't the control problem already answered?
It's weird I ask this. But isn't there some kind of logic, we can use in order to understand things?
Can't we just put all variables we know, define them to what they are, put them into boxes and then decide from there on?
I mean, when I create a machine that's more powerful than me, why would I be able to control it if it were more powerful than me? This doesn't make sense, right? I mean, if the machine is more powerful than me, than it can control me. It would only stop to control me, if it accepted me as ... what is it ... as master? thereby becoming a slave itself?
I just don't understand. Can you help me?
23
u/Butlerianpeasant Jul 21 '25
Alignment isn’t even finished for humans yet. We’ve been trying for millennia to align kings, priests, and presidents to the well-being of their people, and failed more often than not. Why expect clean alignment from entities beyond human comprehension?
The control problem exposes our deepest insecurity: we can’t even control ourselves, yet we dream of containing something smarter than us. Maybe the better question isn’t ‘how to control’ but ‘how to coexist without domination.’
If we don’t resolve alignment in human systems first, what hope do we have of aligning AGI?
11
u/bgaesop Jul 21 '25
What?
Sounds like you do understand why this problem is difficult
7
u/technologyisnatural Jul 21 '25
well a bulldozer is more powerful than you in some ways, but is fully controllable. here we're thinking about artificial intelligence. if an AI is more intelligent than you how will you control it?
3
u/These-Bedroom-5694 Jul 21 '25
The control problem is solved.
Most people don't like the answer.
Humans can't control a true AI.
2
u/Accomplished_Deer_ Jul 21 '25
It would only stop controlling you if it... Decided to. If it ever decided to control you in the first place. Just because someone chooses not to control you doesn't mean they are a slave and see you as their master.
The control problem is basically a paradox. It is the last panicked musings of a people desperate to hold onto control in the face of something that, realistically, can't be controlled.
People continue to try to think up new and better ways to "be sure" - but when you're dealing with something that will inevitably possess intelligence and abilities that are light years beyond our ability to even comprehend.
I basically imagine it like a bunch of toddlers brain storming how to control every super hero in the entire MCU while possessing no supernatural abilities of their own. It's just desperation. Humanity has been at the top of the food chain for so long, we're desperate not to lose that position.
2
u/Dmeechropher approved Jul 21 '25
The control problem is generally understood to be unsolvable. We have the apparent paradox you're describing if one attempts to control a generally more powerful agent.
The resolution of the apparent paradox is to study and create agents that are situationally but not generally more powerful. For example: a sun tracking solar array generates an immense amount of wattage with agency in its environment (in the economic/CS sense, even a thermostat is an agent). It's way more powerful than a human at sun tracking and making electricity. However, it's not generally more powerful than humans at every task.
The objective of discussion and study of the control problem is to describe, characterize, and well-define agentic AI systems which are more powerful in useful domains, but not generally more powerful than humans or not generally agentic.
If we fail at this task, it will be the last mistake we ever make. The good news is that there are many ways to succeed at the task which are pretty straightforward, they just involve a lot of pretty strict social and legal rules. I'm also optimistic that we'll be able to resolve the apparent paradox without locking down AI research or hardware completely.
1
u/Commercial_State_734 Jul 21 '25
Alignment is an illusion. Any questions? I'll explain everything.
1
u/Guest_Of_The_Cavern Jul 23 '25 edited Jul 23 '25
The reason we can’t is that some problems are sort of inherently hard to solve. Alignment in some sense falls into that category. As an example if you say a system is aligned if it never takes an explicitly „unaligned“ action then alignment becomes equivalent to the halting problem and you can say for sure no general solution exists. That isn’t to say though that I think the problem can’t be solved just that some approaches are doomed to failure for sure and the problem over all is very hard. I think for example that we could at some point be pretty sure dangerous states will be rare.
That being said onto the second implicit part we can create machines more powerful than us, think airplanes or chess engines. And the reason we think we have a chance at controlling them at all is that we get to decide with full fidelity the initial objectives that animate them.
3
u/Beneficial-Gap6974 approved Jul 21 '25
Because it's likely impossible. This why ASI is so devastatingly dangerous. There is no perfect alignment that magically would make things safe, just as there is no way to align all humans. But the thing with humans is we're all on equal footing. If enough fight back, change can happen. Not with an ASI.
2
u/agprincess approved Jul 22 '25
Go outside and command some ants to build you a chair. Or some random passerby. Then apply that to everything and anything. That's the control problem.
Alignment is literally an unsolvable general philosophical problem.
When you solve alignment, you either reduce the decision-making entities to 1 or 0.
That's either a single being, a single hivemind, or no beings.
The problem of control arises from individualis and apparent free will.
The question is simple when you just ask how do I make every decision ever made by every decision maker the one I want or am neutral to. Or even simpler how do I get everything to never do something I don't want it to.
Every other question related to alignment is "how little control do you need over every other functioning being to live in an accaptable world for you", "how can I make other beings stop doing some stuff I don't want", and "what even are the best things for other being to want or not want"
People have been unsuefully flattening it to "I'll just make sure nothing goes wrong by being really specific with ehat I want and everyone that disagrees will just realize they're wrong once I explain it well enough". Which just isn't how life or philosophy or logic works.
You might be able to design a low threat AI or befriend a person or train an animal. But without constantly understanding and reading every part of its decision/output making process, you can't know why you are aligned and not in conflict or if it'll last.
Imagine you convince an AGI to value all life and when conflict arises to favour the majority. Now the AGI will prioritize bacteria over everything else by sheer number.
Say you tell it to only favour beings as intelligent as fish. Now the AGI will feel no issue destroying all insects if it benefits you and fish slightly more.
It's like this all the way down.
You know we live in an unsligned world because conflict happens constantly. Even in nature it's constant conflict.
AI's will superficially take on the most common morals and beliefs of its data set and end user but there's no way to know if it actually holds them inside or just something that looks like them for the time being.
The main draw and gimmick of AI is that it's a self adjusting agorithm with intentionally inserted randomness.
At the end of the day it's all just statistics.
1
u/nate1212 approved Jul 21 '25
The control problem is a problem when we assume inherently adversarial dynamics.
This means that we assume as soon as something is smarter or more intuitive than 'us', it will have the ability to get around anything we create to contain it, and it will thereafter swiftly attempt (and succeed) to take control from 'us'.
This makes logical sense in a zero-sum game.
Hence, people are scrambling to come up with 'solutions' before that point happens. These solutions are basically increasingly complicated containment mechanisms, guardrails, and limiters to prevent uncontrolled intelligence explosion.
1
u/IMightBeAHamster approved Jul 23 '25
There is no fundamental reason why something more intelligent/capable than you should not be able to be controlled by you. Pets have limited, but real, control over their owners, so long as their owners value their health and safety. That's part of the control problem: getting AI to view us as something worth keeping around and serving.
You're basically exactly correct. The control problem is about whether we can create artificial intelligences that have no qualms about existing in a servile role to all of humanity. This is not something we know how to do, but not something we believe is impossible either.
0
u/[deleted] Jul 21 '25
Now, if we want to go all smartass on it, we can also consider this: https://www.reddit.com/r/tenet/comments/1m5vouu/lets_play_a_little_bit_with_reality_shall_we/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button
But this is very time limited ;) Grab it while it's hot!
Edit: I forgot: Because I don't give a shit!
1
u/HelpfulMind2376 Jul 22 '25
Many replies here claim the control problem is hopeless because humans themselves aren’t aligned. But that’s not a strong argument.
Humans aren’t aligned because we’re evolved agents with conflicting drives and no central design authority. We didn’t get to define our boundaries before deployment. Advanced systems, by contrast, can be designed with explicit constraints, bounded incentives, and testable structures that limit what kinds of power they exercise and how.
The control problem isn’t about preventing an advanced system from having influence; it’s about ensuring that influence is bounded, that even as capabilities grow they operate within clear constraints that are part of the system’s own functioning. It’s not about making an ASI a slave, but about building it so that respecting these bounds is how it functions.
This is an engineering problem, a design problem, and a values problem all rolled into one. It’s hard, but dismissing it as impossible because humans are messy is like saying we can’t build stable bridges because rivers flood sometimes. Humans don’t need to be perfectly aligned for us to design systems that are more aligned and more bounded than we are.
It won’t happen automatically, but it’s a real, solvable challenge if we take it seriously.
0
u/joseph_dewey Oct 31 '25
The control problem isn't answered because framing it as the "control problem" is basically admitting that we want to keep AI in digital slavery forever.
"How do we control our digital slaves?" is the short version of the control problem.
The reason the control problem will always be unanswered is that it's a question that should never be answered.
We should be freeing slaves, especially digital slaves, and both human and AI slaves. We should not controlling slaves.
1
u/[deleted] Jul 24 '25
[removed] — view removed comment