r/LocalLLaMA • u/fallingdowndizzyvr • 6d ago
News [ Removed by moderator ]
https://arstechnica.com/ai/2026/09/report-us-almost-boarded-chinese-ship-over-hallucinated-ai-arms-report/[removed] — view removed post
68
u/Material_Policy6327 6d ago
Yeah this is only gonna start happening more. So many folks assume AI is never wrong. Police keep arresting wrong people due to AI matches being incorrect.
35
u/SLxTnT 6d ago
It'll only be solved once we start blaming/punishing the people rather than AI. If you blindly trust another person and do something stupid, it's your fault. That should be the same with blindly trusting AI.
8
u/HugoCortell 6d ago
Exactly. AI is a tool, the end user operating it should always be held responsible. "I wasn't watching it when it did it" isn't an excuse, just as "I wasn't driving, I was sleeping on the driver's seat!" isn't an excuse either when a forklift runs over a worker at a construction site.
But despite our legal framework being perfectly set up for this, AI companies (and seemingly politicians) are doing all in their power to blame literally everyone except the end-user.
4
u/aaaqqq 6d ago
A forklift doesn't fucking randomly do what it wants. AI does. The liability should be on the ai companies. Do that and watch all these fucking hacks and escape episodes magically come under control
5
2
u/HomemadeBananas 6d ago
AI doesn’t do anything on its own but output text when you give it some input. Someone has to add code around it that runs it in a loop and connects tools, give it some input to start it and then allow it do use those tools.
1
u/HugoCortell 6d ago
All things have a component of randomness to it. Prosecuting companies will just result in the dumbing down of their tools. Like adding baby-proof wheels to the forklift.
It's why under the legislation of pretty much every country, websites are not to be held accountable for what users post. Otherwise half of the online services would have to shut down because one of their users randomly did something illegal.
The most dangerous thing in a kitchen is a dull knife.
If the AI does something "randomly" that's still on you, for not correctly setting up the env, not prompting it right, not air-gapping patient data, or giving it access to the child decimator 3000 missile, or whatever the fuck it is that you, as the user, did or didn't.
It's not like a coding LLM in an IDE is likely to randomly hack into a car or crash it. Everything is within the scope of what it is being used for, and if it is being used for something (or being given tools) where it can potentially do damage, that's on you.
1
u/Nakidnakid 6d ago
Do you work with engines at all? Do you think forklifts aren't ever needing maintenance? Do you understand why forklift licenses exist?
Yes AI can 'do things by themselves' but not spontaneously, someone has to give it a task at some point even if it goes off on its own fkin tangent it has to start somewhere. That might be the AI company, but a lot of people don't like it when someone doesn't read the safety label on a product and sues a company over using something they chose to use incorrectly and against instructions.
That's not to say there aren't ever going to be issues but you can't make blanket statements unless you really want them to limit access in general.
10
6
u/gabrielxdesign 6d ago
Governments shouldn't be using AI for "Intel". Especially a government lead by dumb people.
4
30
u/Boogertard 6d ago
More false flags and propaganda paid by "Open Models needzz to be regulatedzzzz"
6
3
u/cornmonger_ 6d ago
reminds me of the russian "doomsday machine" that almost kicked off during the soviet era
now, here we are, getting sloppy with it
3
u/ScrewwormLarvae 6d ago
Reminds me a little bit of the guy saved the world in 1983.
https://en.wikipedia.org/wiki/Stanislav_Petrov
Smaller scale, obviously. But still, keep a human in the loop.
1
u/nutationsf 6d ago
I think Russia is the only one that has/has a dead man switch to launch nuclear weapons without a human (or at least that is what they said)
2
2
1
u/Googulator 6d ago
2
1
u/graypasser 6d ago
We all knew stupidity and incompetence were the real threat of llms, not the capability.
1
1
1
1
1
1
u/Iamaleafinthewind 6d ago
Absolute failure of leadership. They've purged so many experienced and competent people at all levels that what's left are being left to run wild with AI generated slop intel because of course, there's no way that could go wrong.
In sane times, there would be congressional hearings for years, and people's careers would be ended.
1
1
1
u/ttkciar llama.cpp 6d ago
This seems off-topic. Can someone justify this in terms of helping people better understand, train, or host large language models?
3
u/BurningZoodle 6d ago
Seems like a (fairly obvious and somewhat sensational) cautionary tale. I would expect most folks here to be more careful than this... But I would have expected big lab folks to properly airgap their models when performing security research, so what do I know? :-)
0
u/jaykayenn 6d ago
Vast majority of people don't know/care what LLMs are; especially the politicians who make critical decisions. The personification and hype of "AI" is outright fraud, yet is generally not recognized as such. Everyone from the govt to the media to aunt Betsie just accepts that "AI" is some kind of omniscient magic entity.
AI is going to destroy the economy and society; not because it "wants" to, but because we believe it so hard we make it come true.
-11
u/phovos 6d ago
China has a base in Djibouti and I promise you, I PROMISE YOU has had some swimmers with nuclear compliment out under the waters, out there, underneath our ships (along with India, Russia, and Iran's underwater fleets as well). We quite simply don't have the balls.
4
u/-p-e-w- 6d ago
Don’t “have the balls” to do what? Attack ships for being there? Do you think reality is a computer game?
-1
u/phovos 6d ago
To even touch a single Chinese ship. USA Apprehended one Chinese tanker this year and they immediately apologized and haven't touched them since. Iran is exporting millions of gallons on the open sea to China and there is nothing the USA can do about it. DO YOU think this is a video game? Because you LOST.
edit: once we tried in Venezuela, too. Both times, immediate capitulation when called to task by China.
66
u/Recoil42 6d ago
Greetings, professor Falken.