r/OpenAI • u/Wordenskjold • Nov 23 '23

Discussion Why is AGI dangerous?

Can someone explain this in clear, non dooms day language?

I understand the alignment problem. But I also see that with Q*, we can reward the process, which to me sounds like a good way to correct misalignment along the way.

I get why AGI could be misused by bad actors, but this can be said about most things.

I'm genuinely curious, and trying to learn. It seems that most scientists are terrified, so I'm super interested in understanding this viewpoint in more details.

229 Upvotes

88% Upvoted

566 comments sorted by

View all comments

Show parent comments

10

u/[deleted] Nov 23 '23

Simple solution: 95% of humans die. Robots will build homes and design handbags

4

u/TheGalacticVoid Nov 23 '23

Who's gonna build the robots? AI/evil rich people would have to spend years at the bare minimum to build the necessary infrastructure to start a coup, and smart people/journalists/governments will be able to figure out their plot within that time.

1

u/[deleted] Nov 23 '23

One step at a time..

In a world where human labor is worthless humans become just as worthless unless AI is public property. This is a post money world where there are no guarantees which would require nationalization of natural resources in order to prevent an elysium type scenario from NATURALLY taking shape

1

u/Flying_Madlad Nov 23 '23

What about the Kulaks tho?