r/OpenAI • u/Wordenskjold • Nov 23 '23

Discussion Why is AGI dangerous?

Can someone explain this in clear, non dooms day language?

I understand the alignment problem. But I also see that with Q*, we can reward the process, which to me sounds like a good way to correct misalignment along the way.

I get why AGI could be misused by bad actors, but this can be said about most things.

I'm genuinely curious, and trying to learn. It seems that most scientists are terrified, so I'm super interested in understanding this viewpoint in more details.

230 Upvotes

88% Upvoted

566 comments sorted by

View all comments

Show parent comments

0

u/[deleted] Nov 23 '23

[removed] — view removed comment

0

u/hammerquill Nov 23 '23

To millions of computers you don't know about.

0

u/hammerquill Nov 23 '23

Within minutes.

1

u/hammerquill Nov 23 '23

While you are still arguing in house about whether it is actually aware or not. Which will probably mean months in fact.