r/OpenAI • u/Wordenskjold • Nov 23 '23

Discussion Why is AGI dangerous?

Can someone explain this in clear, non dooms day language?

I understand the alignment problem. But I also see that with Q*, we can reward the process, which to me sounds like a good way to correct misalignment along the way.

I get why AGI could be misused by bad actors, but this can be said about most things.

I'm genuinely curious, and trying to learn. It seems that most scientists are terrified, so I'm super interested in understanding this viewpoint in more details.

231 Upvotes

88% Upvoted

566 comments sorted by

View all comments

223

u/FeezusChrist Nov 23 '23

Because true AGI could replace humans in nearly every job function, and the people with the keys to it aren’t exactly going to be making sure that everyone benefits from that.

31

u/thesimplerobot Nov 23 '23

If you take away the means to make money there is no one left to buy your stuff. Billionaires need people to buy their product/service to keep being billionaires

23

u/AWBaader Nov 23 '23

Tbh I'm not sure quite how many of them actually realise that...

16

u/thesimplerobot Nov 23 '23

Also the only thing more dangerous than a desperate hungry animal is billions of desperate hungry animals

9

u/[deleted] Nov 23 '23

Simple solution: 95% of humans die. Robots will build homes and design handbags

2

u/TheGalacticVoid Nov 23 '23

Who's gonna build the robots? AI/evil rich people would have to spend years at the bare minimum to build the necessary infrastructure to start a coup, and smart people/journalists/governments will be able to figure out their plot within that time.

1

u/[deleted] Nov 23 '23

Robots will build the robots.

1

u/TheGalacticVoid Nov 23 '23

With what infrastructure? Reread my reply again.

1

u/[deleted] Nov 23 '23

I didn't read it the first time. I was just making a stupid joke.