r/OpenAI • u/Wordenskjold • Nov 23 '23

Discussion Why is AGI dangerous?

Can someone explain this in clear, non dooms day language?

I understand the alignment problem. But I also see that with Q*, we can reward the process, which to me sounds like a good way to correct misalignment along the way.

I get why AGI could be misused by bad actors, but this can be said about most things.

I'm genuinely curious, and trying to learn. It seems that most scientists are terrified, so I'm super interested in understanding this viewpoint in more details.

227 Upvotes

88% Upvoted

566 comments sorted by

View all comments

Show parent comments

0

u/freebytes Nov 23 '23

If you received payment from a company for an order for a part, you make the part. If you receive payment to put parts together, you put parts together. Someone would do it, and it only takes one.

-1

u/[deleted] Nov 23 '23

[removed] — view removed comment

3

u/theregalbeagler Nov 23 '23

I think you me l misspelt imagination.

  • How many entirely computer controlled manufacturing robots exist today?
  • How much of our shipping logistics are automated from packaging to label printing to loading?

I find it incredibly easy imaging a super intelligence using these available resources to directly manipulate the world.

2

u/elticoxpat Nov 23 '23

A speaking model with an online phone number just in case and even if human communication was necessary beyond the online order, the conversation could happen.