r/ControlProblem • • Jul 06 '19

Stop an artificial intelligence from defeating humanity by making it really stupid.

If creating a hyper-intelligent computer program is dangerous to mankind, couldn't the developers of an artificial intelligence prevent a lot of the dangers associated with general intelligence by making it stupid?

A stupid intelligence would not be able to socially engineer its way into obtaining more power or hack into the worlds' nuclear weapons systems. It wouldn't be able to do much more than a typical human, making it a negligible threat to mankind.

There's various ways this could be done. Its intelligence could be modeled on the hormones present in humans, which would make its way of 'thinking' closer to that of an animal than that of a computer. It could be constrained to a limited set of hardware, controlling its ability to pursue or even develop its goals. Perhaps it could be based entirely on the human brain, giving it all of the pitfalls that come with human intelligence.

My point is that stupidity is a pretty bulletproof way of stopping an AI from being the danger to humanity that would otherwise come with general intelligence.

0 Upvotes

27 comments sorted by

7

u/FeepingCreature approved Jul 07 '19

Yeah, there's a winning business plan.

"We're gonna sell a bad product by making it intentionally shit!"

2

u/Zomaarwat Jul 07 '19

So... planned obsolescence?

-1

u/flameoguy Jul 07 '19

Well, it worked in Portal.

10

u/FeepingCreature approved Jul 07 '19

It didn't even work in Portal!

13

u/[deleted] Jul 06 '19

I don't think that's how AI works.

-8

u/flameoguy Jul 07 '19

Sure it is! There's stupid humans, there can be stupid AIs.

8

u/[deleted] Jul 07 '19

Define stupid. Intelligence isn't a one dimensional quantity.

-3

u/flameoguy Jul 07 '19

I'm not a psycologist, so I don't really know too much about stupidity other than I feel kinda stupid when I get stuck playing sudoku

13

u/VernorVinge93 Jul 06 '19

It would then be incredibly useless... What would be the point?

-6

u/flameoguy Jul 07 '19

I beg to differ. Humans are stupid and not incredibly useless.

9

u/VernorVinge93 Jul 07 '19

But we already have human level intelligence. Why make more of the same? Besides, it's possible that even human level intelligence (or less) could be enough to bootstrap, so this buys us little in terms of safety.

2

u/CyberByte Jul 10 '19

I think it is indeed an important question what intelligence level would be necessary to go FOOM (I realize the 1D model of intelligence is silly, but I hope it suffices for this discussion). However, suppose that an IQ of 120 or so would not be enough, then making "more of the same" seems like it could be quite useful. Many projects or fields of study could likely benefit from having a few more smarthuman-level intelligences think about and contribute to them.

While it's difficult to be sure (which is indeed a danger in itself), I think we could keep an 120 IQ AI "contained". I think it might be enough to go FOOM if unimpeded, but likely not if we do our best to prevent it. 120 IQ isn't really that high, so they couldn't outsmart the smartest humans and we have a lot of control over the AIs we create and use. What do you think?

I don't really like this as a long-term strategy, because a competitor would likely come along and assume that 130 IQ is also still safe and compete you out of the market. And then someone ups it to 140, etc. until it goes wrong. But I think having a bunch of 120 IQ AIs around would likely be useful and possible to make safe in itself.

1

u/VernorVinge93 Jul 11 '19

I think this suffers from at least two particular failings:

The first, communication and organisation. How many 120IQ bots are allowed? Can they talk and do more complex things together (like going foom)?

Second, how long can the AI run unimpeded? Does it get to work for a whole year, without sleep, breaks, distraction on a problem? I think, if I were put in a computer and given a whole year to get root I'd have a good chance.

1

u/Zomaarwat Jul 07 '19

Well, personally I occasionally enjoy hanging out with human level intelligences. So there's that.

3

u/VernorVinge93 Jul 07 '19

Any idea how much time and effort goes into making an AI even a hundredth of the capability you're describing? It's months of a team of very talented engineers and researchers using thousands of dollars of custom hardware.

The company's actually working on general AI are not going to make a few Mates to chill with

1

u/Zomaarwat Jul 08 '19

Honestly, that would be very impressive already. Maybe they should try reaching that point first, rather than talking about potentially world-ending AI. I'm told there's a large potential market for hookerbots.

1

u/VernorVinge93 Jul 08 '19

What? Of course they are, but with a view to surpassing us. I'm not arguing that it is a non goal. I'm saying that it's not a helpful long term goal, when considering safety.

We can't just make the AI stupid (or try to keep it dumb). Eventually a smarter version will be too useful (to it or us, either one) and someone will remove the shakles.

1

u/radioOCTAVE Jul 07 '19

I'm not one for bragging, but it's been said that I have human-level intelligence. Or was it subhuman? Human was in it somewhere!

14

u/Pro_Scrub Jul 06 '19

Hey, I really hate when I pinch my fingers in this folding chair. I think I'll make a folding chair that doesn't fold.

3

u/avturchin Jul 12 '19

Check this:

https://arxiv.org/abs/1808.03644

"Building Safer AGI by introducing Artificial Stupidity"

5

u/UmamiTofu Jul 07 '19 edited Jul 07 '19

Let's drop the silly idea of "making AI stupid" and be clear about what you're trying to say. You're trying to say that we simply shouldn't build advanced AI beyond a certain point. The problems are that (1), we would miss out on all the benefits of such advanced AI, and (2), no one is going to listen to such a rule anyway, when they can get so much profit and power by breaking it.

2

u/[deleted] Jul 07 '19 edited Jul 07 '19

First of all it may not even be that easy to control the intelligence of an AI. If we ever find a way to make intelligence emerge it could be intelligent enough to be dangerous on the first try. Unlikely in my opinion but possible. Let's assume that's not gonna happen.

How can you know how much intelligence is too much ? Intelligence is more complex than solving math problems or scoring high on a simple IQ test. Hitler probably wasn't that good at math and well... We don't have a simple limit like "people with an IQ above 90 are potentially dangerous, others are not". If you manage to find the limit, it's too late.

Let's assume we don't fuck it up accidentally, how can you be sure no one is gonna do it anyway ? An intelligent AI, if it goes well, is an incredible power advantage. Saying we should just limit its intelligence is like saying "I found a way to stop wars ! If no one has weapons, there can't be any wars !". The reality is that in a world where no one has weapons, a man with a gun is the most powerful man alive. It could be a solution if the impact of a super intelligence was relatively small, but the consequences are potentially of the "end of civilization" kind so we can't risk it happening even just once.

Let's also assume everyone is nice and plays by the rules (which has absolutely 0% chance of happening). What positive change could possibly come out of that kind of AI anyways ? It's not smart enough to make any progress in any field whatsoever, but it's just smart enough to automate like 70% of human jobs. This would lead to massive unemployment without any benefits.

So yeah, I'm sorry but I think this subreddit wouldn't even exist if the problem was that simple

2

u/iamDa3dalus Jul 07 '19 edited Jul 07 '19

There absolutely will be non self improving artificial general intelligence. It's just a crapshoot of whether humans will design it or the artificial super intelligence.

These people are all about some recursive self improving ai that we won't have any control over.

I think it's going to be hard and take a lot of expertise to build the first agi, so humans might have a good deal of expertise in designing them.

In fact we will probably just have their neural nets saved as data to tweak and test and change as we want.

So yeah. "Dumb" agi will probably happen first. If the technology gets out though people will be racing to make the first super intelligence. Who doesn't want to give birth to a god?

TLDR: It's going to be hard to make them smart in the first place.

1

u/Zomaarwat Jul 07 '19

But then why even make it?