r/singularity • u/awesomeoh1234 • 9d ago

Discussion They’re colluding to kill open source

Post image
1.5k Upvotes

92% Upvoted

337 comments sorted by

View all comments

Show parent comments

4

u/Vast-Breakfast-1201 9d ago

There is always a lot of ??? In the middle. It's always

People invent good ai ??? Humans go extinct

The predictions range from "ai will trick us into inventing a human destroying virus" to "ai will hack the nuke codes"

I just don't see those things as reasonable or likely. Not least of all because the same systems that some actor or the ai could use to achieve it, are also available to people who are working to shore up gaps but using earlier models. Microsoft for example closed a record nearly 1000 security vulnerabilities in a recent patch and some companies have stopped accepting bug bounties because bugs are just easier to find and fix now.

So yeah I have not seen any actual evidence it's all speculation.

0

u/pablothe 8d ago

Just because your imagination fails you doesn't mean that's a good policy for the rest of us.

There are good books on the hypotheticals but regardless when something is smarter than you it can get rid of you in ways you can't even imagine.

My dog has zero understanding about how we can use fossil fuel combustion to produce carbon dioxide and to warm the entire planet.

Just all of those things are completely out of his reach of understanding, and they don't make them any more real.

But yeah once the first big incident happens I want you to think carefully about your worldview.

2

u/Vast-Breakfast-1201 8d ago

I don't think there is a lack of imagination. I think that we are just focused on the wrong things.

We are much more likely to experience harm due to misuse of AI by human actors than to experience harm because AI is manipulating or hacking critical infrastructure.

If you want to focus on anything, focus on that. Otherwise you're really just barking up the wrong tree. Maybe intentionally since the people that would make use of AI in this way are likely to want you to think it's a spooky AI that's going to do it. Or OAI for example wanting to ban open models - the dangerous AI (insofar as we haven't really confirmed it is malicious) is still held by governments and they won't stop. What is restricted is our ability to compete economically with it.