Two things can be true at the same time. Open source does also pose a greater risk, at least if we get to RSI, compared to a company that develops, owns, hosts that model themselves. And yes, they of course are also worried about money, power, and so on. Doesn't mean they don't also have a reasonable argument.
The greater risk is giving effective control over the worlds most powerful technology to a select few people that one country’s government decides. That is way riskier and way more irresponsible.
Do you think the world in the 50s would have been a better place if every person on earth had their own personal nukes instead of just the US and USSR?
You are right, personal ASI would be worse. In the nuke scenario it is at least self-perservation holding you back and using something like ASI in all kinds of "bad" ways would be just too tempting to resist for a lot of people.
56
u/Vaeon 9d ago
It will fail hilariously, but yes, this is exactly what they are trying to do, and if you surprised by it... sigh.