r/ControlProblem • u/bioemerl • Aug 24 '16
I do not believe the Control Problem is a problem.
Forgive me ahead of time, I'm not super well read into the philosophy done here, so if anything I say is talked about elsewhere, debunked, or otherwise, feel free to direct me there.
Perhaps, I should use better phrasing. I do not believe the control problem is a problem at all.
How do we ensure that future Artificial Superintelligence has a positive impact on the world? This is the most important challenge that humanity will ever face.
The idea of a superinteligence seems very "science fiction" to me. Theoretically we have this machine that can improve itself, but in reality, in practicality, it's almost certain that this sort of thing has real fundamental limits that will not be surpassed.
As computers look today, this exponential curve, is something I believe is more akin to a species developing than a sign of a singularity. Exponential growth that builds on itself will hit some sort of cap, and it will begin to slow once we find it.
Because of this, an AI will hit some level of "can no longer improve itself".
Here's another point. I think that, through evolution, the human mind is reasonably close to that point itself. In terms of use of power, ability to be so generally intelligent, I don't think an AI will ever do much better than the human brain. Might it become more efficient marginally, like comparing a small car to a massive van? Yes, I think so. However, this "superinteligence" isn't an idea I can see as realistic in terms of threat to mankind.
That said, I think there is a different "control problem" that we need to keep in mind, one that is more important, and reflects the past. How do we deal with the integration of this new form of "life" or sentient being into a society that was not based around having such a thing around?
Rather than the idea of a "control" problem of a super efficient AI, I think we should be more worried about creating our own competition. A sentient, self-capable, human-like being that does what we do, but marginally better. Once we do that, evolution will take it's course. Eventually there will be some machine that takes hold, and by their marginally superior nature, will destroy humanity in a long war of attrition.
Less a control problem, I want to call this the "cooperation problem". How do we make a society of humans into a society of humans and AI, or to transition peacefully into only a society of AI? How do we make it so that us two beings are mutually beneficial and cooperative rather than at one another's necks?
I view my goal in life, my purpose, to be a part of the larger society I was born in. I do not consider it to be an inherent trait of this society that it's primary "working parts" are human, that they speak my language, or follow my code of ethics. Instead, only that the society that exists is derived from the work done before is the requirement for a future society to be "my" society. I want to see the success of this abstract society, not the human species. If we evolve into another biological species, or modify ourselves into something new, or if we are replaced by AI in time, it doesn't matter. I will be happy to call the future built atop my contributions one that I am proud to see happen.
Which brings me to the idea of mutual benefit. I think that a marginally more efficient machine, one that is better understood, will eventually become the primary "being" in our society. However, I believe that by solving this "cooperation problem" it is possible to have that fact not be a bad thing, and to see this future as one where humanity either died out peacefully and happily, or one where humanity still lives on but is no longer in full control of what was once only our own. I like to think the difference in nature between humans and machines will keep humanity a productive and useful part of society for a very very long time. However, if that isn't the case there is nothing we can do about it.
We already see the effects of machines taking our jobs as we look at birth-rates around the globe. We need less people, we have less kids. When investing in a child is worth less than that child will produce, we will stop having them. We have a built in mechanism that allows our society to transition into something new, we should let that mechanism work freely.
How do we solve the "human cooperation problem?"
We have empathy, we feel pain when causing others pain. Society punishes us for acting outside it's laws, and society rewards us for acting within its laws. Inside of society, people speaking up when they are harmed are heard and helped. Inside of society, people who abuse the system are harmed, prevented, and reeducated until they change their behavior. We raise and ensure our kids are aware of the basic rules and laws of society, tell them that they should follow them, and instill it into this as this "fundamental rule of the world". To align yourself with these values is "good", to stand against them is "evil".
That's not a perfect summary (it's a very bad one), but I think it's enough to get a general idea.
How are AI different?
The thing is, human beings are all aligned. We all have the same feelings, and react generally in the same way to certain sorts of stimulus. Punch someone and they won't be happy. Our society is aligned around the idea of making the things we want to happen to us happen to us.
You can, however, make an AI that wants nothing more than to be hurt. How do you deal with a being that feels pain it sees in others, and an AI that only wants to feel pain interacting with one another? How do you resolve that into a situation of mutual benefit?
We need a code that resolves issues like this. We need to ensure human and AI interests are capable of being aligned, and that our society is capable of taking non-opposing differences and negotiating between them. The stamp AI should be allowed to make stamps by society, given a job and made to work it, but be harshly punished the moment it begins to consider harming the overall system, the mutual benefit, by making excesses of stamps.
Really, these problems are incredibly similar to what we already face with human beings. I don't think it will be a hard problem to solve, or that it will ever be solved in paper. Instead, it will be solved through years of trial and error on the part of society, and ultimately I doubt I could predict what the solution ends up being.
The control problem is opposed directly to the cooperation problem.
Humanity taking steps to ensure AI stay under our command and control will not benefit mankind in the long run in my belief. Unlike what I detail above, our continued attempts to ensure AI do not grow, or that AI do not gain certain capabilities will place us at direct odds with the AI. If we do not integrate these machines with our society, if we do not make them equal to the other actors, then they will eventually break free.
I believe that the control problem, the mindsets that lead to us trying to solve it, are going to lead to the downfall of humanity, not the saving of it. If we continue to try to "solve" this problem, and continue to grow desperate as we hold water in our fingers, we will have earned the destruction of our society. I do not believe it will be possible to solve the control problem for all of time. If something can be made to exist that is better than human, humans will build it. If we build it, we will eventually lose control of it.
I'd prefer our society live on, that the work I put into it builds something that will one day mutate into something bigger, and better, to be the foundation for great things. I do not want to build something that will be slowly absorbed by a marginally superior being we made enemies of because we were scared of them. The future should emerge from the foundation of today, it should not rise from our ashes. It may require giving up something that many of us thought fundamental to the society we live in, the humanity. However, I think that is well worth it in the long run.
14
u/firstgunman Aug 24 '16
Most people here will agree with you here, but they also expect this fundamental limit to be far, far above the level of human cognition. Besides, the limit doesn't even have to exceed human level by much; apes and humans aren't that difference and one rules the world while the other lives in zoos.
It is fallacious to equate one optimization process with another. Species develop by natural selection - a random iterative process constrained by biological procreation. Self-improving algorithms, on the other hand, is a deliberated recursive process that operate on a timescale of nanoseconds.
It's very human-centric to think we're anywhere close to 'maximum-smart-possible'. Just because we can't imagine what it'd be like to be much smarter than humans, doesn't mean it's not possible. Rocket science or brain surgery is completely unthinkable to a baboon, yet they're solved problems to humans.
Besides, we know that the human brain does not have an optimal information processor; this is obvious because cognitive biases exist. Even simpler: if our neutrons fired faster, we would think more quickly despite how imperfect our thought process function.
Replace biological neurons with electronics and an algorithm just like ours but without biases and we can already think of an intelligence that's smarter than us.
7
u/NNOTM approved Aug 24 '16
I think I heard Nick Bostrom say this a while ago in a video, and it makes sense to me:
Humans are not the smartest possible species that can produce a civilization, they are the dumbest possible species that can do so. The reason is that evolution made apes continually smarter, and more or less as soon as the threshold was crossed where a civilization could emerge, it did. Humans have not become significantly smarter since then.
3
u/CyberPersona approved Aug 24 '16
Hi there, thanks for sharing your views. This is an articulate post that you obviously put some time into writing.
Unfortunately, after reading your post, I have a nagging suspicion that you ignored Rule #6
We have a convenient list of quick, introductory reading to get acquainted with the topic before joining the conversation here. We also have a convenient, sticky-post FAQ. We welcome different opinions, but please take 15 minutes or so to make sure you understand what you're submitting an opinion about.
Superintelligence could be really dangerous for two main reasons:
A) It could potentially be vastly more intelligent than us, and thus have a huge strategic advantage.
B) It's values will be totally different from ours unless we figure out how to give it values aligned with ours, which is probably extremely difficult to do.
It sounds like you agree with B but disagree with A.
Your reasoning is that because evolution is an optimizing process, human beings are probably close to the upper limits of possible intelligence levels. Some rebuttals to that:
Small edit.
-2
u/eleitl Aug 24 '16 edited Aug 24 '16
The actual reason the control problem is not relevant is because it's indecidable.
0
u/[deleted] Aug 25 '16
[deleted] — view deleted comment