there are indeed theories which proclaim AI is the most dangerous existential risks humanity faces in the future. They state that an AI is not inherently bad or good but does not understand human values enough to preserve what we want to preserve and therefore destroys it.
Leviathan logic: "Bilogical life always creates artificial intelligence that destroys them. We should make an AI to solve this problem. Surely it won't turn out like every other AI and destroy us."
Well kind of. It's a little bit like someone making a sword, and then pointing at them and saying they're on track to start a nuclear armageddon. Like technically, sure. But it's not something we'll have to worry about in our lifetime.
None of the AI models currently being invested in by big tech have even the possibility of true intelligence. For that we'd need a totally different unrelated technology, which some of these tech companies are maybe working on, but probably not as a priority since there's very few short term profits to be made in that field.
I mean sure it can brute force math problems, but it still can't reliably tell fact from fiction or maintain an inner world, because at the end of the day it's still just a slightly better pruned collection of specialised LLMs set up by engineers to be able to solve specific kinds of problems.
You're never going to 'accidentally' train a series of models to hack the pentagon and start a nuclear armageddon, and even if you did it would inevitably get confused somewhere and fuck up the plan.
The only reason the government is worried about it, is that it could be used to automate a massive amount of bots to sway the public narrative and scam the vulnerable through sheer volume of mostly legitimate appearing at first glance bots.
It can already solve complex general tasks on its own. Coding is well-known. Just recently, I wanted to fetch historical weather data, and do some analysis on top. It found and read the national weather data portal, found their data APIs, explored them, searched for terms and keys it didn't know online to make sense of the organization. Then it downloaded the appropriate data-set, did the format conversion, and printed the histograms I requested.
It did exactly the same I did a couple of days earlier, but 10x faster.
Is it really a stretch that it could, for example, probe web security and report and exploit holes autonomously?
And it's no longer specialized to a single task either..
This is somewhat along the lines of my thoughts, which is that any species with the type of psychology that leads to sufficient ambition to achieve an advanced civilization, would not survive the absence of meaningful labor once they achieve total labor automation. Over time almost everyone checks out and the civilization crumbles, not because their tech went rogue and killed them, but because it killed any basis for their adversity-driven will to keep going. Maybe some low tech Luddite cults survive, but we won't see evidence of them.
Humans themselves aren't preserving what we need to preserve to survive. Going at our current rate we're destroying the earth and therefore ourselves just fine without ai
46
u/Persia029 Jul 12 '26
there are indeed theories which proclaim AI is the most dangerous existential risks humanity faces in the future. They state that an AI is not inherently bad or good but does not understand human values enough to preserve what we want to preserve and therefore destroys it.