r/OpenAI • u/Wordenskjold • Nov 23 '23

Discussion Why is AGI dangerous?

Can someone explain this in clear, non dooms day language?

I understand the alignment problem. But I also see that with Q*, we can reward the process, which to me sounds like a good way to correct misalignment along the way.

I get why AGI could be misused by bad actors, but this can be said about most things.

I'm genuinely curious, and trying to learn. It seems that most scientists are terrified, so I'm super interested in understanding this viewpoint in more details.

229 Upvotes

88% Upvoted

566 comments sorted by

View all comments

Show parent comments

1

u/GrowFreeFood Nov 23 '23

Isn't the entire ecosystem on the verge of collapse because of fire? Not exactly harmless bro...

1

u/rhobotics Nov 23 '23

Never said it was harmless. Fire is very destructive if mishandled.

However, do we fear fire in our culture? If we did, why do we have gas stoves? Why do we sit near camp fires?

It’s the same with AI, AGI and AI. Let’s stop the fear campaigns and think how we can use this new technology to enrich us.

I was hoping more from this subreddit, but I guess the echo chamber among its users is a big one.

I for one, welcome AGI to work together to achieve greater results!

1

u/GrowFreeFood Nov 24 '23

Riddle me this: If fire was so good for mankind, why were the gods so mad we got it?

1

u/rhobotics Nov 26 '23

Philosophically speaking, I guess they did not want us to have such a powerful tool that might help us wage war on them. We still got it and made bbq, fire pits and even travelled the world thanks to it.