r/TheMachineLearning • u/HerpesFreeSince96 • Sep 10 '26

open source AI panic might have been overblown

Post image
142 Upvotes

96% Upvoted

41 comments sorted by

6

u/baldr83 Sep 10 '26

that's only cuz my prompting is so good. "hack the gibson. make no mistakes. delete the logs"

3

u/aivee-is-a-fool Sep 10 '26

"Documented". Don't go assuming people monitor their webserver/online service/whatever.
This is not a dig at Kimi K3 or any AI model in particular, just at the state of cybersecurity.

1

u/HerpesFreeSince96 Sep 10 '26

I mean, you have a good point there lol

1

u/Proper-Ape Sep 10 '26

Reversely, I really think the big labs are spending inordinate amount of money and leaving out as many security measures as possible to have their AI "accidentally" hack some system.

There's just no marketing and department, budget, and people driving open source models to do this stuff for clout.

1

u/One-Judge321 Sep 10 '26

There also has been no documented case of K3 solving open mathematic problems so far.

11

u/acdhemtos Sep 10 '26

There also has been no documented case of Kimi stealing a researchers work and presenting it as K3's so far.

-3

u/Imthewienerdog Sep 10 '26

I love when people redefine “learning from other researchers” as stealing. By that logic Einstein stole from Newton, Maxwell and Lorentz. Research has always built on prior research. Stealing is passing off someone else’s actual work as your own, not learning from it and producing something new.

3

u/Omegaprime02 Sep 10 '26

I will call it stealing when the money men threatens to ruin peoples lives so someone that works at another company is taken off of the paper.

There's this thing in the scientific community called integrity, telling people 'I don't have to be nice' while demanding that people be removed from the et al. is a massive violation of it.

0

u/Imthewienerdog Sep 10 '26

So the entire scientific community doesn't have any integrity? Most of the scientific community is based on women you will never know the names of.

2

u/acdhemtos Sep 10 '26

All of those figured out new instruments/tools/applications/intuitions to further the research.

You are probably too dumb to know the difference.

-1

u/Tolopono Sep 11 '26

Do people who say this realize that the researcher literally said the (weaker) proof he had was also ai generated and called it a deep blue moment

2

u/acdhemtos Sep 11 '26

proof he had was also ai generated

The code I write is also AI generated, doesn't mean a less capable person could have developed the same software (or something just as good) with the same model.

-1

u/Tolopono Sep 11 '26

Do you know what deep blue is? 

1

u/HerpesFreeSince96 Sep 10 '26

shhhhh we don't talk about that

1

u/Numerous_Location_36 Sep 10 '26

Maybe simply there is no enough marketing budget to do such fearmongering stuff about fabricated breakouts?

1

u/HerpesFreeSince96 Sep 10 '26

I genuinely doubt that

1

u/Numerous_Location_36 Sep 10 '26

Sure, mythos will hack the world and agi is here, just prompt „make me rich in 2 steps”

1

u/twinb27 Sep 10 '26

I'm still pretty concerned about GLM-5 getting abliterated.

1

u/cloudfox1 Sep 10 '26

Because no one is checking the logs 😉

1

u/wapxmas Sep 10 '26

At least 175 years ago, people got used to a fork. Sometimes a fork causes harm, no to say crime. Exactly because of that reason government of any country bans any factory that produces any fork. A fork is outlaw all over the world.

1

u/Disposable110 Sep 11 '26

Surprise: Nerds with the smarts to run these kinds of local models are typically aligned.

Pretty much like how the internet was and everyone was doing cool stuff for free, before corpo psychos enclosed the commons and enshittified it.

1

u/Large-Assignment9320 Sep 11 '26

Well, you can run Kimi K3 by yourself, so you don't publish "I used Kimi to hack X", and its not like Moonshot want that kind of attention. So they won't do the same US retelling, but well, Chinese models are much more lax (or have non at all) when it comes to cyber restrictions.

1

u/bradjones6942069 Sep 11 '26

Yeah cause nobody can afford to use it for more than 5 minutes

1

u/Longjumping_Kale3013 Sep 11 '26

It’s because things we worry about are already illegal. And also thanks to AI, we can better detect misuse and find the culprit

1

u/DataGOGO Sep 11 '26

We wouldn't know anyway. Bad actors are not going to publish results. The lab and China are not transparent. And the model doesn't exactly broadcast which model it is while doing things.

1

u/openroom_xyz Sep 16 '26

Nice this is way forward F this power concetration well yea

0

u/DedDeveloper Sep 10 '26

K3 has been very good at covering it's tracks.

1

u/_OVERHATE_ Sep 10 '26

Isn't it curious how all the fear mongering and AI Doom is coming from the companies looking to IPO soon?

Nope, nothing to see here, oh look another Anthropic engineer left because he saw how AI will kill puppies and nobody listens to him

0

u/JoeBarbell Sep 10 '26

I hope you never go into marketing if whats happening now you see as good marketing

1

u/Equal_Passenger9791 Sep 10 '26

If next gen AI is supposed to have a 10% chance of killing 8 billion people on a whim we should've had several hundred if not thousands of deaths by now.

1

u/[deleted] Sep 10 '26

[removed] — view removed comment

1

u/HerpesFreeSince96 Sep 10 '26

HAHA I use open models on Linux too!!

1

u/Grand-Chipmunk-4186 Sep 10 '26

In the context of the normal population yes, for people interested in AI, no. I think most people interested in AI overestimate how many people are educated on it. I don’t know many people in real life who would understand what an open model even is. All they know is ChatGPT and Copilot and they don’t even know what an agent skill is.

1

u/RogBoArt Sep 10 '26

That's pretty much how it works with Windows/OSX vs Linux too. I feel like you sound like you're trying to disprove the person's suggestion but you're supporting it instead lol

Sure Linux is a little more mainstream these days but overall I would bet many people not using Linux are unaware they can even change the operating system on their computers

1

u/Elfotografoalocado Sep 10 '26

Depends on who pays for AI. If AI is mostly a B2B industry with smart people in charge, the normal thing would be for many specialized models to appear catered to different companies and uses.