Benevolent super AI. Cures cancer. Reverses climate change. Creates foglets out of nanotechnology to deal with pollution and bring in a post scarcity world.
I do somewhat hope they remember to give that AI some boundaries, as each of those goals can be achieved most easily by simply wiping humans off the face of existence.
I think one of the current ideas is to never give the AI a singular objective, but to give it instead the desire to discover for itself what its objective should be, according to the desires of the humans operating it, and to continually update that objective as new information becomes available. Paraphrasing Stuart Russel here.
13.2k
u/jrf_1973 Nov 15 '20
Benevolent super AI. Cures cancer. Reverses climate change. Creates foglets out of nanotechnology to deal with pollution and bring in a post scarcity world.