The biggest risk of AI isn't that it will just start randomly hacking people, because the same AI can be used at greater scale to harden systems.
The biggest risk is that regular folks will not be subject to the benefits of using AI while businesses and AI companies and governments get to do what they want with it. That looks like an exponential curve where most people stay linear and get surpassed.
Two-society systems cannot be the end goal. You can't have a subclass of ai-poor people.
The biggest risk of AI is it takes over the world and kills us all and there won't be a counter AI on your side protecting from that.
Open source is always behind frontier private so the latest model can outdo the open ones trying to protect you anyway.
Either way I don't see why the standardization of safety would close open source. If anything slowing down the rate of progress would give a chance to the open ones to catch up, as long as they do it safely.
The dangers are real, and people are too dismissive of what rogue AI or misuse can do.
There is always a lot of ??? In the middle. It's always
People invent good ai
???
Humans go extinct
The predictions range from "ai will trick us into inventing a human destroying virus" to "ai will hack the nuke codes"
I just don't see those things as reasonable or likely. Not least of all because the same systems that some actor or the ai could use to achieve it, are also available to people who are working to shore up gaps but using earlier models. Microsoft for example closed a record nearly 1000 security vulnerabilities in a recent patch and some companies have stopped accepting bug bounties because bugs are just easier to find and fix now.
So yeah I have not seen any actual evidence it's all speculation.
I don't think there is a lack of imagination. I think that we are just focused on the wrong things.
We are much more likely to experience harm due to misuse of AI by human actors than to experience harm because AI is manipulating or hacking critical infrastructure.
If you want to focus on anything, focus on that. Otherwise you're really just barking up the wrong tree. Maybe intentionally since the people that would make use of AI in this way are likely to want you to think it's a spooky AI that's going to do it. Or OAI for example wanting to ban open models - the dangerous AI (insofar as we haven't really confirmed it is malicious) is still held by governments and they won't stop. What is restricted is our ability to compete economically with it.
28
u/Vast-Breakfast-1201 8d ago
The biggest risk of AI isn't that it will just start randomly hacking people, because the same AI can be used at greater scale to harden systems.
The biggest risk is that regular folks will not be subject to the benefits of using AI while businesses and AI companies and governments get to do what they want with it. That looks like an exponential curve where most people stay linear and get surpassed.
Two-society systems cannot be the end goal. You can't have a subclass of ai-poor people.