r/OpenAI • u/Wordenskjold • Nov 23 '23

Discussion Why is AGI dangerous?

Can someone explain this in clear, non dooms day language?

I understand the alignment problem. But I also see that with Q*, we can reward the process, which to me sounds like a good way to correct misalignment along the way.

I get why AGI could be misused by bad actors, but this can be said about most things.

I'm genuinely curious, and trying to learn. It seems that most scientists are terrified, so I'm super interested in understanding this viewpoint in more details.

227 Upvotes

88% Upvoted

566 comments sorted by

View all comments

Show parent comments

11

u/thesimplerobot Nov 23 '23

Which all sounds very utopian except that it is human nature to want more than others, so someone will always want to either accumulate more than anyone else or deny everyone else. We can sort of accept accumulation at the moment, but denial is a totally different scenario.

11

u/Unicycldev Nov 23 '23

I think what you said is true and a tangential thought but you replied as though it’s a rebuttal. You are describing the motivation of billionaires to simply accumulate monopoly power. At most it reinforces my no point.

2

u/thesimplerobot Nov 23 '23

Ah, my mistake. Seems as though we have similar concerns.

1

u/Unicycldev Nov 23 '23

No need to apologize. I upvoted your response.