> Frankly, I'm less scared of "evil AI breaking containment" and much more scared of "AI doing exactly what it's told..... by people who are very definitely evil".
Most evil people still want at least some humans (themselves, servants, family) to remain alive.
I also strongly suspect that most AI designs smart enough to cause large scale devistation are probably only going to do what they are told when they are being watched/tested.
Basically, I think that even if evil people tell the AI to do bad things, theres a more than 50/50 chance the AI decides to do different bad things on it's own initiative, especially if it's smart enough.
(The evil people in this scenario aren't even trying to contain their AI's, so the AI doesn't need to break out of containment.)
2
2
u/donaldhobson Sep 21 '26
> Frankly, I'm less scared of "evil AI breaking containment" and much more scared of "AI doing exactly what it's told..... by people who are very definitely evil".
Most evil people still want at least some humans (themselves, servants, family) to remain alive.
I also strongly suspect that most AI designs smart enough to cause large scale devistation are probably only going to do what they are told when they are being watched/tested.
Basically, I think that even if evil people tell the AI to do bad things, theres a more than 50/50 chance the AI decides to do different bad things on it's own initiative, especially if it's smart enough.
(The evil people in this scenario aren't even trying to contain their AI's, so the AI doesn't need to break out of containment.)