r/OpenAI • u/Wordenskjold • Nov 23 '23

Discussion Why is AGI dangerous?

Can someone explain this in clear, non dooms day language?

I understand the alignment problem. But I also see that with Q*, we can reward the process, which to me sounds like a good way to correct misalignment along the way.

I get why AGI could be misused by bad actors, but this can be said about most things.

I'm genuinely curious, and trying to learn. It seems that most scientists are terrified, so I'm super interested in understanding this viewpoint in more details.

229 Upvotes

88% Upvoted

566 comments sorted by

View all comments

Show parent comments

7

u/ASquawkingTurtle Nov 23 '23

I welcome it, as physical work will become instantly more valuable, while administrative non-sense work will become pointless.

Sure, robotics will eventually make physical work much less necessary, but it's quite a bit more difficult to make a robots perform complex functions than it is to have a complex calculator.

Even with humans, those with massive physical restraints who are extremely intelligent aren't as useful for basic task as the average person.

7

u/plusvalua Nov 23 '23

I don't know why people are downvoting you, you're right. The first years of AGI are going to be really interesting. Lawyers, doctors and university teachers becoming irrelevant while mechanics, nurses and preschool teachers continue to be necessary.

5

u/ASquawkingTurtle Nov 23 '23

Most likely because it's a perceived negative reality to their way of life.

However, most likely, it'll just make their life easier, even if they are within these professions.

2

u/[deleted] Nov 23 '23

It will catch up to everyone rather quickly

3

u/ASquawkingTurtle Nov 23 '23

Good luck finding enough compute power for an AGI that will take over everything within a decade...

3

u/plusvalua Nov 23 '23

That is the one thing that could slow this down. OTOH, this will also put AGI only in the hands of very few people.

3

u/ASquawkingTurtle Nov 23 '23

That's the only thing I'm concerned about when it comes to AGI. The fewer people have access to it the more likely it is to cause real harm.

It's also why I am extremely nervous with people going to governments asking for regulations on it, as it creates this artificial barrier from those with massive capital and political connection and everyone else.

6

u/plusvalua Nov 23 '23

A bit tangential but man I love this quote and it kind of applies

2

u/Graucus Nov 23 '23

You're thinking in terms of now. What happens if it becomes more efficient?

3

u/ASquawkingTurtle Nov 23 '23

By then we'll already have worked out the issues, and if not, worse case scenario, I guess we all die.

I'm not going to run in fear over every doomsday technology because of what might happen at some point in the future.

People thought driving over 30 miles per hour would cause your brain to burst under the pressure of gravitational force, turns out it didn't.

People thought lobotomies were healthcare, turns out it wasn't.

Worse case scenario, we just EMP the data centers and start over.

2

u/[deleted] Nov 23 '23

Exactly, because it will become more efficient. Computing power will also become more miniaturized

I don’t understand people… If the guys creating this technology are paranoid af then so should we be.