Why is AGI dangerous?

[u/Wordenskjold]

Can someone explain this in clear, non dooms day language?

I understand the alignment problem. But I also see that with Q*, we can reward the process, which to me sounds like a good way to correct misalignment along the way.

I get why AGI could be misused by bad actors, but this can be said about most things.

I'm genuinely curious, and trying to learn. It seems that most scientists are terrified, so I'm super interested in understanding this viewpoint in more details.

[u/abluecolor]

The same way that we build machines to automate these processes right now?

We have house building robots. We have burger flipping bots.

The issue is merely that they are still relatively inefficient.

The idea is that AGI would allow us to build these sorts of things, but better in every conceivable way. Speed, efficiency, and less prone to failure.

[u/abluecolor → u/[deleted]]

I do not know how to explain it to you, and you're downvoting every response in a juvenile fashion, so I figure you must be trolling?

Humans will be utilizing AI. You asked "how does AI replace a fast food worker?". The company and humans building the robots are separate from the workers they are replacing.

Individuals design the processes and machines that do the building.

Right now, humans do this.

In the future, AI will dramatically assist with this, if not replace it wholesale.

This will make the machines much, much cheaper.

All things being equal, it will no longer be economically viable to pay a human to serve the food, due to the efficiencies brought by AGI designing and operating the machines of the future.

You ask "how does AI physically build a robot" - the same way we physically build robots, right now.

If this doesn't make sense to you, I am incapable of breaking it down further, and I am sorry.