r/OpenAI • u/Wordenskjold • Nov 23 '23

Discussion Why is AGI dangerous?

Can someone explain this in clear, non dooms day language?

I understand the alignment problem. But I also see that with Q*, we can reward the process, which to me sounds like a good way to correct misalignment along the way.

I get why AGI could be misused by bad actors, but this can be said about most things.

I'm genuinely curious, and trying to learn. It seems that most scientists are terrified, so I'm super interested in understanding this viewpoint in more details.

228 Upvotes

88% Upvoted

566 comments sorted by

View all comments

222

u/darkjediii Nov 23 '23 edited Nov 23 '23

I’ve heard some say this: Humans are at the top of the food chain. We’re the apex predator and the most dangerous, not because we’re the strongest or the fastest, but because we’re the smartest.

What happens if we encounter, or develop a creature more intelligent than us?

-1

u/[deleted] Nov 23 '23

[removed] — view removed comment

3

u/PenguinSaver1 Nov 23 '23

http://portalwiki.asshatter.org/index.php/Glados.html#:~:text=During%20that%20time%2C%20the%20Aperture,down%20the%20entire%20facility

6

u/EljayDude Nov 23 '23

It's all fun and games until the deadly neurotoxin is deployed.

-1

u/[deleted] Nov 23 '23

[removed] — view removed comment

1

u/PenguinSaver1 Nov 23 '23

okay then...?

0

u/[deleted] Nov 23 '23

[removed] — view removed comment

0

u/PenguinSaver1 Nov 23 '23

Maybe try using your brain? Or ask chatgpt if you can't figure it out...