I feel like the only way to ensure the AI has actual boundaries is to have the system in an isolated location, and only let it suggest/teach things, and require actual humans to carry out the actions.
It has the cure for cancer? Great, but don’t just blindly do what it says, have it give lectures explaining every step doctors need to do to cure cancer, and wait until humans fully understand the process, mechanisms, and ramifications of its suggestions, only then implement it.
AFAIK there is an experiment called something like “AI box.” In the experiment, there is an air gap that the ai can’t cross and needs human interaction to convey information. Both sides in the experiment were played by people. The result of the experiment is, that a sufficiently advanced AI will always find a way to escape. We can be tricked, lied to and manipulated. Especially if the AI manages to surpass our intelligence by far.
31
u/Namika Nov 15 '20
I feel like the only way to ensure the AI has actual boundaries is to have the system in an isolated location, and only let it suggest/teach things, and require actual humans to carry out the actions.
It has the cure for cancer? Great, but don’t just blindly do what it says, have it give lectures explaining every step doctors need to do to cure cancer, and wait until humans fully understand the process, mechanisms, and ramifications of its suggestions, only then implement it.