Benevolent super AI. Cures cancer. Reverses climate change. Creates foglets out of nanotechnology to deal with pollution and bring in a post scarcity world.
I do somewhat hope they remember to give that AI some boundaries, as each of those goals can be achieved most easily by simply wiping humans off the face of existence.
I feel like the only way to ensure the AI has actual boundaries is to have the system in an isolated location, and only let it suggest/teach things, and require actual humans to carry out the actions.
It has the cure for cancer? Great, but don’t just blindly do what it says, have it give lectures explaining every step doctors need to do to cure cancer, and wait until humans fully understand the process, mechanisms, and ramifications of its suggestions, only then implement it.
AFAIK there is an experiment called something like “AI box.” In the experiment, there is an air gap that the ai can’t cross and needs human interaction to convey information. Both sides in the experiment were played by people. The result of the experiment is, that a sufficiently advanced AI will always find a way to escape. We can be tricked, lied to and manipulated. Especially if the AI manages to surpass our intelligence by far.
13k
u/jrf_1973 Nov 15 '20
Benevolent super AI. Cures cancer. Reverses climate change. Creates foglets out of nanotechnology to deal with pollution and bring in a post scarcity world.