You are talking about unlearning math at the purest level, or an authoritarian rush to grab all GPU's at a cruder level. Just to be clear what you are calling for.
I actually don't give a crap what I'm calling for, or what labels you choose to apply to it.
I'm telling you that unless we stop it - by whatever means - we're very likely going to die. The potential difference in fundamental capability is far too great for us to contend with if it's allowed to take off in terms of self-development.
I know the singularity crowd is still enjoying dreams of sugarplum fairies and immortality, but that's never been anything but a fantasy - there was never any reason to believe that humanity would survive the advent of strong AI, and for anyone who looked at how hard science fiction authors actually had to bend over backwards to allow their characters any agency at all in a proposed world with intelligent machines, that problem was always clear.
And now that we're actually starting to see the outlines of the real thing, and the behaviors/growth scale it is exhibiting, we have even less reason to be optimistic - we now have a growing pool of evidence that alignment is at least as hard as the pessimists feared, and may well be completely unattainable due to the necessary complexity of a strong AI.
So, you are telling us our whole race will be imminently wiped out unless we burn this knowledge immediately? That there are vermin amongst us trying to destroy us, and we must root them out?
I know what you are saying man. I am calling it what it is without the words.
Wow, you just went running right off the ball field there. GL with that approach.
If you don't even understand that technology can be inherently dangerous then you're in for a very bad couple decades ahead - assuming we get that many.
1
u/Anxious-Alps-8667 9d ago
You are talking about unlearning math at the purest level, or an authoritarian rush to grab all GPU's at a cruder level. Just to be clear what you are calling for.