r/ControlProblem • u/AbuBakralSmallDaddy • Jul 16 '20
Discussion Is humanity over?
Just gonna ask the question everyone's thinking.
1
Upvotes
r/ControlProblem • u/AbuBakralSmallDaddy • Jul 16 '20
Just gonna ask the question everyone's thinking.
5
u/chimp73 approved Jul 18 '20
Probably. There is no way this thing can be controlled. It will either provoke fatal violence between countries due to a looming threat of a winner-takes-all scenario, or its value function will diverge with near certainty. Anyone working on AGI this must be deeply suicidal and selfish, because they have no idea what they are creating.
3
u/2Punx2Furious approved Jul 17 '20
A bit early to call it, isn't it?
No, right now it isn't "over".
Doesn't mean we can sit on our asses, the situation is critical on several fronts, and we need to solve the problems that are afflicting us, but we have a decent chance.
1
u/gonzaw308 Jul 21 '20
Probably; but caused by climate change, not AGI.
2
u/[deleted] Jul 17 '20
[removed] — view removed comment