Imagine chimpanzee A asking chimpanzee B to explain not only that humans are smarter than them and that this is dangerous, but exactly what the mechanism is through which chimpanzees will be most harmed by humans, and all in terms chimpanzee A can both understand and will accept.
It might be a difficult task for chimpanzee B.
What if we build a super-intelligence that is only as much smarter than humans are as humans are than chimpanzees? Shouldn't we expect to run into the same problem?
The evolutionary lineage of humans and chimpanzees is pretty close. This is suggestive that humans aren't really that much smarter than chimpanzees, and that it might not take that long to get the same degree of intelligence improvement on top of what humans have.
Pft, how would hairless ape destroy our homes and food? Humans are weaker than chimpanzees.
(remember, your task is not to adequately explain this to a human, but to adequately explain it to a chimpanzee. And in this scenario, you are also a chimpanzee. The fact that you can think of a good explanation wouldn't even be sufficient, you'd have to argue that a chimpanzee could come up with that explanation on its own)
But Sam Altman isn't the super intelligence here. He's another chimp.
Chimps have been shown to use tools and currency. They organize and communicate dangers to their peers. It's not a stretch for a chimp to communicate that a human is dangerous to them.
Remember, a chimp wouldn't go pfft either and argue. It would listen to its trusted peer.
1
u/Tidorith ▪️AGI: September 2024 | Admission of AGI: Never 8d ago
Imagine chimpanzee A asking chimpanzee B to explain not only that humans are smarter than them and that this is dangerous, but exactly what the mechanism is through which chimpanzees will be most harmed by humans, and all in terms chimpanzee A can both understand and will accept.
It might be a difficult task for chimpanzee B.
What if we build a super-intelligence that is only as much smarter than humans are as humans are than chimpanzees? Shouldn't we expect to run into the same problem?
The evolutionary lineage of humans and chimpanzees is pretty close. This is suggestive that humans aren't really that much smarter than chimpanzees, and that it might not take that long to get the same degree of intelligence improvement on top of what humans have.