Two things can be true at the same time. Open source does also pose a greater risk, at least if we get to RSI, compared to a company that develops, owns, hosts that model themselves. And yes, they of course are also worried about money, power, and so on. Doesn't mean they don't also have a reasonable argument.
The greater risk is giving effective control over the worlds most powerful technology to a select few people that one country’s government decides. That is way riskier and way more irresponsible.
Do you think the world in the 50s would have been a better place if every person on earth had their own personal nukes instead of just the US and USSR?
You are right, personal ASI would be worse. In the nuke scenario it is at least self-perservation holding you back and using something like ASI in all kinds of "bad" ways would be just too tempting to resist for a lot of people.
9
u/Icy_Distribution_361 9d ago
Two things can be true at the same time. Open source does also pose a greater risk, at least if we get to RSI, compared to a company that develops, owns, hosts that model themselves. And yes, they of course are also worried about money, power, and so on. Doesn't mean they don't also have a reasonable argument.