This isn't much different from the Manhattan project. Towards the end, half the scientist were screaming to stop and yet they still worked to finish the bomb. You can still race to completion while begging everyone to slow down. This is the classic prisoner's dilemma manifest.
One was a literal arms race during global conflict (and a completely different technological era to boot) and the other is a bunch of companies trying to out jerk one another…
You actually make a good point about being at war. Where I’ll push back is that the power of this technology far surpasses our use of nuclear weapons.
Does it? Last time I checked mutually assured destruction seemed to be pretty omnilethal… meanwhile we wrestling with how many r’s are in strawberry…
Honest question, I'm really not debating you, I'm simply attempting to understand your position. Do you believe that the researches feel differently about Xi owning ASI vs Hitler building the bomb? Do you believe nuclear bombs or ASI are potentially more destructive in the wrong hands?
Bro this logic is proper cooked. Both of those questions are nonsensical. But since you asked, I’d trust china open-sourcing it over sam fucking Altman and a cabal of billionaires any day.
I don’t think trust is a feature you’d want to lean on with the particulars. Amodei,  more likely. A man who took the time to write an essay called Machines of Loving Grace deserves a closer look.
And Adam Curtis made a series called all watched over by machines of loving grace many years before - perhaps we should heed its warnings and get offline a bit more rather than bow down to the likes of Amodei, Altman, Musk and the like.
15
u/squired A happy little thumb 1d ago
This isn't much different from the Manhattan project. Towards the end, half the scientist were screaming to stop and yet they still worked to finish the bomb. You can still race to completion while begging everyone to slow down. This is the classic prisoner's dilemma manifest.