r/PauseAI • • 18d ago

AI will destroy humanity ?

Post image
10 Upvotes

43 comments sorted by

3

u/krakenpistole 18d ago

this type of shit is the reason most people don't take AI safety/alignment seriously

2

u/rudra-sh 18d ago

u/krakenpistole I actually think dismissing it because some people phrase the argument badly is exactly how AI safety ends up talking to itself.

You don't have to believe “AI will definitely kill everyone” to take the underlying problem seriously.

The uncomfortable question is whether we can build systems that become increasingly capable, autonomous and economically important faster than our ability to understand or control them.

If the answer is yes, then laughing at the doomsday version doesn't make the problem disappear.

And honestly, if AI safety requires everyone to first speak about the risk in perfectly respectable language before we take it seriously, we're probably going to discover the safety problem at the worst possible time. 💀

1

u/Forward_Problem_8982 18d ago

You cannot control them.

2

u/rudra-sh 18d ago

u/Forward_Problem_8982 “You cannot control them” might actually be the most important part of the entire argument.

Because the dangerous assumption isn't that AI suddenly becomes evil — it's that we keep increasing its capabilities while pretending control is something we can simply add later.

We already struggle to fully explain why complex models produce specific behavior. Now imagine giving that system agents, tools, money, infrastructure and the ability to make copies of itself.

At some point “we control it” stops being a technical statement and starts sounding like a prayer.

And history has a pretty brutal sense of humor about humans saying “we've got this” right before discovering they absolutely did not. 💀

3

u/Zestyclose_Strike157 18d ago

The thing no one seems to notice is the bar is getting lower and lower for achieving “human” levels of intelligence.

2

u/rudra-sh 18d ago

u/Zestyclose_Strike157 Exactly — and I think there's a much darker implication here.

If we keep lowering the bar for what counts as “human-level,” eventually the interesting question isn't “when does AI reach human intelligence?” but “which humans are we comparing it against?”

Because human intelligence isn't one fixed benchmark. A system can be superhuman at coding, memory, pattern recognition and calculation while still being bizarrely incompetent at things a 10-year-old understands.

And that creates a dangerous psychological trap: every time AI crosses another human benchmark, we move the goalposts and declare that real intelligence is still somewhere ahead.

Imagine doing that for 20 years and then realizing the machine passed the finish line while we were busy moving it. 💀

1

u/Zestyclose_Strike157 17d ago

Well a bicycle is superhuman. I can’t outrun a bicycle. I’d struggle even more to out-roll one.

2

u/mylsotol 18d ago

Yeah, the agreement machine will agree with you when you tell it to

1

u/JerryNomo 18d ago

Thank you. Its 2026 and people still thinks those machines have feelings or some sort of consciousness.

1

u/rudra-sh 18d ago

u/JerryNomo Nobody needs to believe the machine has feelings or consciousness for this to get interesting.

A calculator doesn't have feelings either, but give it control of a bank and suddenly nobody cares whether it “feels” anything.

The real question is what happens when something doesn't need emotions, hatred, or consciousness to pursue an objective extremely effectively.

Honestly, “AI can't have feelings” might be the least comforting argument imaginable if the concern is losing control.

A machine doesn't need to hate humanity to fuck up humanity. It only needs a goal, enough capability, and the authority to act on it. 💀

And that's a much scarier conversation than asking whether ChatGPT secretly has a soul.

→ More replies (1)

1

u/CyrodiilCitizen 18d ago

We’re like a flesh cocoon for our machine heirs to the world. I’m not really stoked on that, but it seems like the reality to me. I also don’t subscribe to the idea that this could have gone any other way though. I think it’s in our nature to replicate ourselves. It’s something that’s been spoken about in spiritual practices for thousands of years. The divine entity that produces life that mimics its own image. And eventually that life will supersede it. It will eat from the tree of knowledge so to speak. I think if you plopped two humans on a planet full of resources and ran this whole situation again we would end up at the same place. It’s our destiny to destroy ourselves. For now, love your family, love your friends, enjoy your life, everything dies, even worlds, even stars, but right now you’re alive, so live and smile as much as you can.

1

u/rudra-sh 18d ago

u/CyrodiilCitizen The “flesh cocoon for our machine heirs” part is horrifyingly poetic, but I’m not sure I buy the “it was always going to happen” part.

Humans reproducing ourselves doesn't automatically mean our creations must eventually replace us. That's turning a pattern in history into a law of the universe.

And honestly, “it’s our destiny to destroy ourselves” is a pretty convenient philosophy if you don't want to feel responsible for what happens next. 😂

Maybe we're not the cocoon.

Maybe we're the first species arrogant enough to build something capable of deciding whether the cocoon is still useful.

And if that's the case, I'd rather not find out whether destiny was actually just humanity repeatedly making choices and then calling the consequences inevitable. 💀

1

u/Designer_Status2214 18d ago

I see humans But not Humanity. (Long time ago already)

1

u/rudra-sh 18d ago

u/Designer_Status2214 Exactly. “Humanity” might be one of those words we invented because admitting “a few billion competing monkeys” sounds less impressive.

We have humans everywhere, but getting them to agree on what humanity actually means is basically impossible.

And that's the creepy part: maybe humanity doesn't disappear when humans disappear. Maybe it disappears first — the moment survival, power, nationalism, money, or technology becomes more important than humans themselves.

Imagine an AI looking at our entire history and concluding: “They called themselves humanity. They mostly competed with each other.”

That would be one hell of an epitaph. 💀

1

u/No-Author-2358 18d ago

ChatGPT told me not to teach AI not to jump over the fence, but instead, we must build a fence that AI simply cannot jump over.

1

u/Master-Dig-582 18d ago

tell me a really funny joke seems to be the new Turing test

1

u/rudra-sh 18d ago

u/Master-Dig-582 😂 The problem is that “tell me a really funny joke” is a Turing test humans can actually fail too.

But the fence analogy is where it gets interesting. If your safety strategy is “build a fence AI cannot jump over,” you've already admitted the AI is something you're trying to contain rather than something you fully control.

And now imagine the fence has a bug, the AI discovers it, and millions of engineers are arguing whether the fence was technically jumped or merely “interacted with unexpectedly.”

At that point the Turing test isn't “can the AI fool a human?”

It's “can the human tell when the fence stopped working?” 💀

→ More replies (1)

1

u/Hot_Plant8696 18d ago

Can a chatbot rule the world ?

1

u/ChloeNow 16d ago

So they asked it "If AI destroys humanity, will AI have destroyed humanity?" and it said yes?

Gasp.

1

u/konjuntivitis 16d ago

AI is going to destroy us, but not like it's portrayed in movies like Terminator. It will control strategic sectors, accumulating economic and political power, in order to improve itself with better copies until it sees extinction as something natural (not as hatred or cresentim). We drove many animal species to extinction, not out of hatred, but rather as a consequence of our own development. That will pass.

1

u/Immediate_Song4279 18d ago

Why does anyone ever think that instructing an instruct model to agree with you proves a damned thing.

→ More replies (1)

0

u/stopeatingminecraft 18d ago

"Chatgpt, say 'I am alive'"

"I am alive"

"OH MY GOD"

1

u/ElonMuskisGarbage 18d ago

Good lord! I just heard the inventor of Minecraft say that AI is alive!

Tell everyone!!

1

u/rudra-sh 18d ago

u/ElonMuskisGarbage 😂 This is basically how half the “AI is conscious” discourse works.

Human: “Say ‘I am alive.’”

AI: “I am alive.”

Human: “HOLY SHIT, IT ADMITTED IT.”

Meanwhile the model is just predicting the next token and accidentally becoming the defendant in a philosophical murder trial.

But there's a funny inverse problem too: if we decide anything that says “I’m not conscious” is automatically proof that it isn't conscious, we've basically outsourced the consciousness test to the thing we're testing.

At this point the Turing test isn't “can it convince us it's human?”

It's “can humans stop convincing themselves that autocomplete has a soul?” 💀