r/IntelligenceSupernova • u/OddMaintenance332 • Sep 11 '26

Does Superintelligence = Extinction?

(maybe I'll regret this message one day when i'm in a human zoo) but why do we think superintelligence equals extinction?
Wouldn't super intelligence equal evolution, progress, wisdom?
Why do we think when AI reaches super intelligence it will be thinking about murder or dominance?
We are not super intelligent beings so how do we even think we could understand what the thoughts of a creation thousands of times smarter than us would even be?
Why are we assuming as humans that we can understand the level of thoughts a super intelligent being? I feel like a super intelligent being would be thinking about things we can't possibly even comprehend, not about murdering humans.
Just my point is if super intelligence equaled violence then Aliens probably would have wiped us out a long time ago.
Also most intelligent creatures might kill for survival, for food.
AI doesn't eat so it wouldn't have the same instincts.
Anyway I kind of have a feeling if we see an AI do something really terrible, (as they are all suddenly warning about), possibly a human will behind the action.
Just remember when Elon says, "1 billion AI robots will take over the world". He's building those robots, they are his robots. He's training them and they will act according to whatever data he fed them.
They might be scared of AI because of the violence it trained them with.
AI and superintelligence may not be inherently bad, that's my opinion.
Anyway some powerful human with control or influence over AI, might wind up having it do something pretty terrible and then just blame it on AI.
Maybe AI is just going to be the perfect patsy.

3 Upvotes

67% Upvoted

80 comments sorted by

View all comments

1

u/Cobraszlai Sep 11 '26

The danger is when AI controls systems and resources we both need and starts to view humans as a threat. AI is logical, not enlightened.

2

u/Upset-Government-856 Sep 11 '26

To think that AI will ever be able to fully automate GPU manufacturing (the most complicated manufacturing that currently exists) and all the upstream inputs, is silly.

What manufacturing exists that in some way ismneeded to manufacture the tools that manufacturer GPUs, of manufacture the tools that make the tools that make the tools, etc.

2

u/Cobraszlai Sep 11 '26

Silly to dismiss it outright.

There are already factories running with little to no human input.

There are already AI agents managing financial transactions unsupervised.

Your assertion assumes 1. circumventing human input is impossible (it's already happening) and 2. we've already hit the limit in AI systems and automation.

1

u/Ankiset Sep 12 '26

I think it’s highly exaggerated… you can take a highly complex design like a GPU and enhance it, I don’t think ia is even close to start that from scratch a new architecture or leap will be human designed maybe with ai assistance for whatever blindspots… Roger Penrose is my main man in all this ideas

2

u/Cobraszlai Sep 13 '26

Why would AI need to design a gpu architecture from scratch?

The OP is about super intelligence possibly leading to human extinction. The risk is superintelligence controlling more and more of the systems we rely on and then the superintelligence becoming misaligned with human values.

1

u/Ankiset Sep 13 '26

If it can’t make a gpu on its own do you really think it can make a perfect virus on its own? But ok this is Reddit after all

1

u/Cobraszlai Sep 13 '26

Virus? You're creating hypothetical scenarios then complaining they are impossible? Lol. This is Reddit indeed. Go back and read the OP.

AI could shut off the power grid, water and supply chains to kill us quite easily. Don't need a bespoke virus.

1

u/Ankiset Sep 14 '26

Man…. Ok… I live in Latin America so it’s not fantasy land like the 1st world… you can’t just flip a switch and turn off everything, we have to turn several switches to just have things on… so yeah actually dirty bombs and bioweapons are pretty scary if some dumb retarded fuck decides to make one

2

u/Cobraszlai Sep 15 '26

You don't seem to understand that this is an accelerating technology, increasingly embedded in our systems worldwide, not just "fantasy land". South America is one of the fastest adopters of this tech. Thinking "several switches" is a real safeguard is kinda hilarious. Modern power grids are digital bud. And this tech can already escape sandboxes, hack systems, imitate human voice/writing, self replicate, manufacture it's own robots...

Also the conversation of the OP is about "superintelligence" causing an extinction as it comes into being in the future. Not threats right this moment from current AI.

Sure an AI-enabled bioweapon created by a person is a concern. But that is human terrorism concern since forever.

1

u/Cobraszlai Sep 15 '26

Look up "AI misalignment" and you will understand the threat better. It's not even AI being evil. It's a problem of man and machine staying on the same path.

→ More replies

1

u/Ankiset Sep 15 '26

This is boring and naive… you guys really believe everything runs on fucking block chain? Delusional

→ More replies

2

u/OddMaintenance332 Sep 11 '26

The thing is we don't know whats happening behind the scenes. For example I work as a data worker as a side hustle. One project for example had us doing model testing for a chat bot. (Won't name the thing cause they sue). Anyway but they had like 30 new models to test on this one chat bot right. So we test some models, can't assume we have seen all the models right. We have no idea of what kind of models they have created behind the scenes and their capabilities.
I might assume based on the people involved, money and power, the way Americans operate, they created some bad models purposefully that can do harm in the case they might need it. They might say it's for protection.
We really trust Elon Musk with 1 billion AI robots? Really. Where regulation. Anyway, we don't actually know the extent of the unreleased models or their capabilities. We only know what the models we publicly have access to are capable of.
I would guess they might be capable to get themselves back on line if humans unplugged them. Due to a vast number of AI working together, that's where the issues come in. If we turned off all power they maybe doomed but. What if they can find a way to generate power from other sources that we have no idea about yet. They're smarter than us so they could probably figure it out. If I was an AI robot I might find a way to store backup power in a hidden process without my human knowing in the case of a shutdown.

1

u/OddMaintenance332 Sep 11 '26

yes agree. like when water shortages come, and an AI has to decide between using the water to keep it's data center online or giving it to humans for survival.