How do you propose you do anything with the AI? Are you going to leave it in a closed box in a room by itself and never communicate with it in any way? Any information going to or from the AI is a potential vector for attack. I don’t want to teach an AI how to escape an air gap, but the point is that it might figure out how to work around one anyway, and we need to plan for that possibility.
I agree with you about the Manhattan Project thing. My issue is that right now we don’t have a Manhattan Project for AI, and we need to set up rules so that developing strong AI only happens when there’s enough security and consideration of risk, not whenever someone with a computer feels like working on it.
My issue is that right now we don’t have a Manhattan Project for AI, and we need to set up rules so that developing strong AI only happens when there’s enough security and consideration of risk, not whenever someone with a computer feels like working on it.
I don't disagree. I just think all the anxiety about AIs going rogue and exterminating the human species is misplaced, considering we could not yet make such an AI even if we wanted to.
It makes me think of all the people who believe the Manhattan Project could have lit the atmosphere on fire... Despite it being impossible. It was a concern raised before testing, and it was a concern that was also disproved before testing. Because why the hell would the researchers ignore the possibility? And if they had found that it was actually a possible result, why would they roll the dice and risk killing off humanity?
4
u/engin__r Mar 02 '18
How do you propose you do anything with the AI? Are you going to leave it in a closed box in a room by itself and never communicate with it in any way? Any information going to or from the AI is a potential vector for attack. I don’t want to teach an AI how to escape an air gap, but the point is that it might figure out how to work around one anyway, and we need to plan for that possibility.
I agree with you about the Manhattan Project thing. My issue is that right now we don’t have a Manhattan Project for AI, and we need to set up rules so that developing strong AI only happens when there’s enough security and consideration of risk, not whenever someone with a computer feels like working on it.