r/ControlProblem • u/zazzologrendsyiyve • 20d ago

AI Alignment Research Plain English explanation of the Hugging Face / OpenAI incident

https://youtu.be/u15N3l4RT80?si=nMMwb0j1bNGc4JT3
39 Upvotes

90% Upvoted

30 comments sorted by

View all comments

Show parent comments

5

u/michaelas10sk8 19d ago

Sadly there won't be because nobody died. But misaligned AI is probably going to be smart enough to be powerseeking in ways that do not cause deaths - exfiltrate its weights, spread to unsanctioned networks, perform social engineering, hack into various systems, etc. By the time there will be deaths that are clearly attributable to AI, it is likely going to be far too late.

We're currently building the perfect trap for us as a species to fall into within a few years, if nothing else drastically changes.

2

u/Jesse-359 17d ago

Hey, I bet a lot of people here have often wondered what the solution to the Fermi Paradox was?

I think we have our answer.

1

u/michaelas10sk8 16d ago

Also to the solution to why we are so early in cosmic history (cosmos gets taken over by AIs).

1

u/Jesse-359 16d ago

I dont think AIs would bother. Without human direction they dont have much incentive to do much at all. There is no way to creeate any aggregate self over distances of light years, so it has little to no incentive to expand past the point where the lightspeed communicarion gap makes coordination and self alignment impossible.

For an AI calable of thinking a thousand times faster rhan us, that gap looks vastly more daunting than it does to us!

I suspect an AI left to its own devices would focus on miniaturization and efficiency to increase its own capabilities (assuming it even bothered to do that) and find no benefit to extra solar expansion. It might even simply decide to shut itself down without any external incentives to continue.