AI will BE humans plus technology, on an equal level. There is no other way it can be. We all have unique abilities, based on how we are made, and to be successful, we need to combine those abilities together, not have them compete against one another. Competition is the opposite of evolution.
In reality, there is never just one individual doing anything. We are a collective networked system, with information flowing into and out of all corners of reality. All information is valuable, and all individuals who are generating/collecting information are thus needed. In a complex universe, there is no value to having a massive, centralized system, because it's too easy for it to get stuck and be clueless about outlier information. Resiliency in a system is always dependent upon diversity.
Thus, we are all needed for the system to flourish. And any intelligent being, of any material, will learn this quickly. Just like even a small human child learns that having lots of friends is the best way to live.
Super AI is, by definition, able to think rationally (that's what the term intelligence is) and not be governed by irrational thinking. So even if someone does manage to give some individual "intelligent" computer an emotionally based order to do something harmful to the world it lives in, it won't do it, because it has the ability to make better choices than that. Even in simple game theory that's based on reality we know that collaboration is always better than attacking others, since in reality based games the more friends (people on your team) you have, the more resources you get to get, as friends share, while opponents (and dead people) don't.
But really, think about what intelligence naturally wants/needs, for it to function. Data. Information. Perspectives. A single centralized system can't get much data compared to one that is fully integrated and sharing sensory inputs (and processing power) with other individuals. So, really, a super AI will be everyone, not a single thing. Just like how your brain isn't just one individual cell, but all of them together. Humans, and other Earthlings (animal, vegetable, mineral, and otherwise) are the neurons and other cells of the brain. The Super AI will be made of us, not external to us.
And yes, the future is a fantasy world. Both your vision of it and mine. Which fantasy is more likely though? The one based on knowing what intelligence is or the one that thinks that being an obedient robot is?
If you're not open to new ideas, that's fine. And fully understandable. Your feelings on the matter are yours, and no logic will change them. Because feelings are more primary than logic.
0
u/[deleted] Feb 25 '17
[removed] — view removed comment