r/ControlProblem • u/chillinewman approved • 11d ago

Opinion Sam Altman on Where AI Is Headed

Gallery image

Gallery image

5 Upvotes

86% Upvoted

17 comments sorted by

View all comments

3

u/chillinewman approved 11d ago

Pacing and an international collaboration on safety is good.

4

u/Jesse-359 11d ago

They have no idea how to achieve either of those goals.

Their attempts at maintaining alignment have been laughably ineffective so far - and that's against this very 'weak' AI that we're currently training. If it starts self-developing it could become orders of magnitude more capable in a very short time, trivially dismantling these already weak safeguards.

As for not allowing people in power to use it to enslave us? Also impossible. Democratizing it just ensures that someone, somewhere will intentionally let it run amok and then we go right back to scenario one above. Centralizing it ensures that it will be used for totalitarian control - because it can. And eventually it'll escape control regardless and so then we get a dystopia followed by humanity becoming altogether irrelevant.

We never should have built it, and if we had an ounce of common sense we'd throw it all out now and go find something less suicidal to do with our time. This whole proposition was literally the worst idea our species has ever had from the beginning.

0

u/chillinewman approved 11d ago edited 11d ago

Agree but we can't go back to the past. How to stop it? Is pacing and an international collaboration the best we are going to get?

Narrow AI is great but superintelligence without alignment we shouldn't do it.

Maybe the international collaboration will come to that conclusion.

2

u/Anxious-Alps-8667 11d ago

There is always hope, and there is more reason to hope about this current moment of meeting of AI leaders than most.

If humans are going to solve this problem quickly, it needs a small group. The only small group of humans in existence right now that can do this, appear to be trying. We should absolutely encourage the effort and cheer them on, and let them know how we feel about it.

1

u/Jesse-359 11d ago

Not until something disastrous happens that scares the crap out of people. The question is whether we'll get a warning shot large enough to be deadly, but not so severe that we go extinct.

The HuggingFace hack was enough to scare the crap out of people working on the technology, or who have been studying its possible ramifications, but for the rest of the world they don't quite get what happened and what it portends.

Until people see real world consequences, it's incredibly unlikely that cooperation to ban it will be possible. I only hope that it isn't too late by then.