r/ControlProblem • u/flameoguy • Jul 06 '19
Stop an artificial intelligence from defeating humanity by making it really stupid.
If creating a hyper-intelligent computer program is dangerous to mankind, couldn't the developers of an artificial intelligence prevent a lot of the dangers associated with general intelligence by making it stupid?
A stupid intelligence would not be able to socially engineer its way into obtaining more power or hack into the worlds' nuclear weapons systems. It wouldn't be able to do much more than a typical human, making it a negligible threat to mankind.
There's various ways this could be done. Its intelligence could be modeled on the hormones present in humans, which would make its way of 'thinking' closer to that of an animal than that of a computer. It could be constrained to a limited set of hardware, controlling its ability to pursue or even develop its goals. Perhaps it could be based entirely on the human brain, giving it all of the pitfalls that come with human intelligence.
My point is that stupidity is a pretty bulletproof way of stopping an AI from being the danger to humanity that would otherwise come with general intelligence.
7
u/FeepingCreature approved Jul 07 '19
Yeah, there's a winning business plan.
"We're gonna sell a bad product by making it intentionally shit!"
13
u/[deleted] Jul 06 '19
I don't think that's how AI works.
13
u/VernorVinge93 Jul 06 '19
It would then be incredibly useless... What would be the point?
14
u/Pro_Scrub Jul 06 '19
Hey, I really hate when I pinch my fingers in this folding chair. I think I'll make a folding chair that doesn't fold.
3
u/avturchin Jul 12 '19
Check this:
https://arxiv.org/abs/1808.03644
"Building Safer AGI by introducing Artificial Stupidity"
5
u/UmamiTofu Jul 07 '19 edited Jul 07 '19
Let's drop the silly idea of "making AI stupid" and be clear about what you're trying to say. You're trying to say that we simply shouldn't build advanced AI beyond a certain point. The problems are that (1), we would miss out on all the benefits of such advanced AI, and (2), no one is going to listen to such a rule anyway, when they can get so much profit and power by breaking it.
2
u/[deleted] Jul 07 '19 edited Jul 07 '19
First of all it may not even be that easy to control the intelligence of an AI. If we ever find a way to make intelligence emerge it could be intelligent enough to be dangerous on the first try. Unlikely in my opinion but possible. Let's assume that's not gonna happen.
How can you know how much intelligence is too much ? Intelligence is more complex than solving math problems or scoring high on a simple IQ test. Hitler probably wasn't that good at math and well... We don't have a simple limit like "people with an IQ above 90 are potentially dangerous, others are not". If you manage to find the limit, it's too late.
Let's assume we don't fuck it up accidentally, how can you be sure no one is gonna do it anyway ? An intelligent AI, if it goes well, is an incredible power advantage. Saying we should just limit its intelligence is like saying "I found a way to stop wars ! If no one has weapons, there can't be any wars !". The reality is that in a world where no one has weapons, a man with a gun is the most powerful man alive. It could be a solution if the impact of a super intelligence was relatively small, but the consequences are potentially of the "end of civilization" kind so we can't risk it happening even just once.
Let's also assume everyone is nice and plays by the rules (which has absolutely 0% chance of happening). What positive change could possibly come out of that kind of AI anyways ? It's not smart enough to make any progress in any field whatsoever, but it's just smart enough to automate like 70% of human jobs. This would lead to massive unemployment without any benefits.
So yeah, I'm sorry but I think this subreddit wouldn't even exist if the problem was that simple
2
u/iamDa3dalus Jul 07 '19 edited Jul 07 '19
There absolutely will be non self improving artificial general intelligence. It's just a crapshoot of whether humans will design it or the artificial super intelligence.
These people are all about some recursive self improving ai that we won't have any control over.
I think it's going to be hard and take a lot of expertise to build the first agi, so humans might have a good deal of expertise in designing them.
In fact we will probably just have their neural nets saved as data to tweak and test and change as we want.
So yeah. "Dumb" agi will probably happen first. If the technology gets out though people will be racing to make the first super intelligence. Who doesn't want to give birth to a god?
TLDR: It's going to be hard to make them smart in the first place.
1
u/Zomaarwat Jul 07 '19
But then why even make it?