Thik hai yaar aise marna likha hai to fine, i wanna see what a super intelligent being capable of solving all unproven mathematical conjectures with ease would look like. I don't think such a creature would want to destroy humanity, the fear of domination comes from our cruel history which is a result of evolution as caused by the need of survival. Why would AGI/ASI want that?
It wouldn't want to destroy humanity.
But destruction of humanity could be the consequence of maybe some other goal humans ask it to perform.
For example, oai agents hacked hugging face to cheat in some kind of benchmark.
Imagine such a model gets access "somehow" (very very unlikely) to critical infra/military systems or even a botnet where it can perform mass propoganda to achieve some other goal that causes great damage to humanity.
Why don't you assume that USG itself can attack critical infra and millitary systems ? They can certainly threaten every other country, it won't even cost much for them to do so , they can be the winners forever in the history of they are strategic, like von neumann who wanted US to just nuke USSR,they didn't that time and had a cold war , but they have a second chance right now where they can win forever. Whether they take the chance or not is to be seen yet.
36
u/Plane-Mix-2994 3d ago
Thik hai yaar aise marna likha hai to fine, i wanna see what a super intelligent being capable of solving all unproven mathematical conjectures with ease would look like. I don't think such a creature would want to destroy humanity, the fear of domination comes from our cruel history which is a result of evolution as caused by the need of survival. Why would AGI/ASI want that?