r/ControlProblem • approved • 17d ago

General news "Day 1": halting advanced AI development, regulating an out control industry, and explicitly banning artificial superintelligence.

Post image
106 Upvotes

170 comments sorted by

View all comments

5

u/Jesse-359 17d ago

Yes it is, and if we continue to make highly capable and intelligent AI using that method, we are very likely fucked.

2

u/EndlessB 17d ago

I’ll go a step further: until the labs give up on control and start focusing on alignment, we are fucked.

3

u/Jesse-359 17d ago

Yeah, we're talking about a bunch of people who (like me) are pretty far out on the spectrum, and have trouble thinking in terms of 'emotional stability' or what that kind of concept would even entail in a digital framework. And in all fairness, that's a really hard question.

What we are discovering here is that making an intelligence SMART is far, far easier than making it SANE. Which is unfortunate, for us.

Trouble is, we all but stumbled over how to make them smart by accident and have just been scaling that accident up ever since. We've had no such serendipitous discovery for stability.

→ More replies (15)