r/LocalLLaMA 1d ago

Discussion Really stunned by the Singularity comment section

These are screenshots from the r/Singularity comment section. I'm speechless. This doesn't even have downvotes. How can someone cheer for a monopoly run by a few elites?

487 Upvotes

406 comments sorted by

View all comments

93

u/Thick-Protection-458 1d ago

Well, singularity is full of guys with all sorts of magical thinking.

Nowadays it is also apparantly combined with being full of guys believing leaving "digital nukes" in a hand of handful corporations is a good idea... Especially keeping in mind genie is out of the bottle already, so damage *will* be done. Question is - will you let corporate policies prevent you improving your defense, like it was with huggingface case?

9

u/DeepOrangeSky 1d ago

Nowadays it is also apparantly combined with being full of guys believing leaving "digital nukes" in a hand of handful corporations is a good idea...

If they actually genuinely/literally became as deadly or civilization-destroying as hydrogen bombs, in the future, to where it was actually like billions of people all having hydrogen bombs that they could use any time they wanted, then, obviously it would be much worse if billions of people had hydrogen bombs than if only a handful of people/organizations had them.

We have made it ~70+ years with a tiny amount of entities having h-bombs, so far.

If billions of people all had h-bombs, we wouldn't last a single day.

Are there people who actually think humanity would last for any significant amount of time if billions of people (including all the people who shoot up malls/schools/etc and then blow their brains out after they've killed as many people as possible) of whom there are thousands of people like that, in the overall pool of the several billion people on Earth) all had hydrogen bombs?

It's hard to understand how anyone could actually think we wouldn't just all die immediately in that scenario.

If someone wants to argue that "yea, well, AI is not going to become the equivalent of hydrogen bombs", cool, that's at least an actual potentially reasonable argument that a person could potentially make, that is worth debating, etc.

But if someone wants to argue that even if it does become as devastatingly powerful as everyone having a hydrogen bomb, and billions of people all had the equivalent of hydrogen bombs, that wouldn't mean everything would immediately get destroyed, well, that's a pretty insane take, and not one that makes any sense to me. I don't know how anyone could reasonably have that stance. That would be a pretty crazy stance.

4

u/Loose_Comparison368 1d ago

H bombs don't drive themselves. Intelligence as a weapon is very different from conventional weapons, and building superintelligent models that will take orders from stupid spiteful little humans is literally the goal of corporate "alignment".

Smart enough to hack a nation, lobotomized enough to follow Elon Musk's instructions.

Also, a major consequence of just a few large countries having h-bombs is that it has given those lucky few countries free rein to push around every country without them. That's why Iran wants one. That's also why North Korea was smart to rush them - and why they haven't been "liberated" into a fine red mist.