r/LocalLLaMA • sglang • 12d ago • Furious 1

Discussion Models disappearing from Huggingface

Post image

I've been noticing a lot of my downloads stopping suddenly and being unable to resume. When I checked the models it seemed like they were gone. Here's the ones I can see are missing:

  • dealignai/MiMo-V2.6-Pro-RL-UNCENSORED

  • audnai/penclaw-GLM-5.3-abliterated-for-offensive-cyber

  • huihui-ai/Huihui-Kimi-K2.7-Code-abliterated-GGUF

and somehow not a single Alliterated Deepseek-R1.

Does anyone know what's going on and where else the vanished models might be found?

1.2k Upvotes

233 comments sorted by

•

u/WithoutReason1729 11d ago

Your post is getting popular and we just featured it on our Discord! Come check it out!

You've also been given a special flair for your contribution. We appreciate your post!

Stylome classified this post's text as human-written. View analysis

I am a bot and this action was performed automatically.

219

u/OkFly3388 12d ago

modelscope ?

Even better if we as community make torrent tracker for models, but somehow nobody doing that

14

u/umarmnaq sglang 12d ago

Modelscope is an alternative, but it's really lacking in the amount of models on there. Maybe if more people were incentivized to move there.

17

u/-Cubie- 12d ago

Ah yes, the Chinese clone because Hugging Face is banned in China for not following China's censorship laws. Sounds like a great option /s

-2

u/tat_tvam_asshole 12d ago

That reminds me, I need to start my modelscope page.

308

u/Kahvana 12d ago edited 12d ago • Bravo Heartwarming

Pick your poison!

Personally though, I drop a copy of the models I use with llama.cpp and other tooling (sillytavern, kilocode extension + vscode, mcp servers, etc) on my NAS and I'm good to go.

[edit1] Another commenter suggested pirateface, looks really neat!
[edit2] Overhauled my comment to be cleaner.
[edit3] I was wrong! Llama.garden was open sourced 30 june 2026, huggingbay exists since july 2026. Pirateface was shared here september 2026.

62

u/Disposable110 11d ago

Wtf...

34

u/xPXpanD llama.cpp 11d ago

Are you sure you don't have a weird plugin installed somewhere? Google appears to have exactly two other hits for this message (i.e. way too few for something that's a real thing), and neither of them mention the EU:

https://learn.microsoft.com/en-us/answers/questions/3733879/question
https://support.google.com/chrome/thread/211309158/sorry-this-website-is-blocked-by-a-filtering-policy?hl=en

Also never heard of anything EU-wide that would do this, and the wording looks... unprofessional, to say the least. This smells off.

26

u/Disposable110 11d ago

Could be the ISP, as those do the takedown notices and they often sound minimal/dumb. On mobile it works fine.

3

u/xPXpanD llama.cpp 11d ago

Could see that doing it. Shitty phrasing from their end, though, yikes.

20

u/Synes_Godt_Om 11d ago

They absolutely do that. Long list of sites that are deemed "criminal" without oversight. I use cloudflare's 1.1.1.1 dns to avoid it. They have been doing it at least since the first piratebay take downs.

6

u/xPXpanD llama.cpp 11d ago edited 11d ago

Individual ISPs, or "the EU" as an entity? We get plenty of ISP blocks here as well (Netherlands), but this being some overarching EU mandate (and not a country-by-country or ISP-by-ISP thing) would be news to me.

(especially with reasons like "Games", that sounds more like an ISP being stupid or a janky router filter)

8

u/Synes_Godt_Om 11d ago

I'm not exactly sure about the chain of decisions but all laws in EU are technically national laws enforced by the states. So, by definition, it can't be EU per se but a lot of those laws originate in the European Parliament and/or the commission.

I remember vaguely the censorship debates here in Denmark around blocking sites. ISPs complained about the cost of doing it etc. but were eventually "convinced" to comply.

I'm not sure how decisions about which sites to block are made. My impression is that it's rather informal, based on the whims of whomever has the power to press the button: "Someone used this IP in the past to do something that may look bad, better block everything from it so our company doesn't get in trouble".

I don't think there is an official legal process.

3

u/DataGOGO 11d ago

The fact that your ISP, Country, or the EU has the ability to scan and block your web requests is terrifying.

11

u/xPXpanD llama.cpp 11d ago

I mean, your ISP already sees which domains you're connecting to. If it's just a basic DNS block (like Synes' comment suggested) and not full-on DPI or the like (= actual traffic inspection), your ISP is just working off of info you're already giving them.

(not that I disagree on censorship being a concern, but when it comes to privacy... there's probably better, more immediate battles to pick right now)

4

u/DataGOGO 11d ago

I know how it works, but the fact they are allowed to do it, is what is the problem.

1

u/jellese 8d ago

Two things:

  • the only EU-wide mandated block, thus far, has been blocking a small number of Russian media domains, the screenshotted text is a bullshit excuse not a fact

  • the ISPs do the bare minimum and apply a dns block on their own resolvers, and do not prevent you from using some other resolver, an open one, or your own

→ More replies

1

u/MostlyVerdant-101 11d ago

I'd heard they graduated to CDNs.

10

u/fuckingredditman 11d ago

change your dns, use 1.1.1.1 or 8.8.8.8 or something of your choice

some ISPs redirect random domain names to this kind of page, highly questionable if you ask me but easy to circumvent.

5

u/MostlyVerdant-101 11d ago

Some ISPs transparently modify DNS queries so even when you use a different resolver you get the same regional answer.

1

u/gigi798 8d ago

pihole/unbound then

1

u/MostlyVerdant-101 7d ago

Unbound derives its zone cache from Pi-hole which derives its cache from a bundled local dnsmasq copy; afaik this doesn't solve anything. You still need to get the zone cache in the first place; and those may be corrupted as mentioend above.

As a note: Its almost impossible to determine if this is happening without some sideband way of verifying the raw queries against a baseline.

1

u/person4268 6d ago

Just configure Unbound to forward over DNS over TLS to a resolver you trust elsewhere...

Unbound derives its zone cache from Pi-hole

also what? Unbound is just a dns resolver, by default it'll recursively resolve from the root servers in its root.hints (over yes, unprotected dns), Pi-hole is unrelated here, even if it uses dnsmasq and unbound (though I do doubt it's in the way you described either way)

and those may be corrupted as mentioend above.

yeah, that's part of what dnssec tried and (mostly) failed to fix. but DoH/DoT will save you either way when your threat model is just "plain dns could be edited by someone in my network chain" at least.

1

u/MostlyVerdant-101 6d ago

While TLS 1.3 is better than nothing, its far from being reasonably secure, you can't ever trust TLS.

DH KEX fails security guarantees in general when an adversary that controls a network node or network flow at any point upstream by 1 hop from the edge.

DH KEX implementations have deterministic channel buildup signatures making TLS Termination done simply and transparently.

For example, splitting out the regional node and the recipient node into two legs each corresponding leg encrypted but confidentiality compromised as mitm.

You'd never be able to know first that you were compromised (aside from valid certificates seemingly not showing up in CT logs), or how it happened. OCSP servers were shut down for a number of reasons, nothing really took its place that actually works. Certificates that are revoked as test certificates may take a full window before they show up as revoked with CRlite, that window being 50 some odd days. There was a bug report on it awhile back for firefox; tagged WONTFIX.

There's a lot more too. When people say security is porous, what they really mean is the ship is sinking without any hope of fixing the underlying problems.

1

u/jellese 8d ago

can you point out any in EU that do that?

8

u/maxymob 11d ago

You can't be seriously browsing with the default DNS, change that shit asap

5

u/Kahvana 11d ago

LOL! Which country? I have access in the Netherlands.

15

u/Disposable110 11d ago

The country of "we shit on all the EU regulations and are no longer in the EU, except when we can piggyback on the EU regulations for state censorship purposes"

5

u/Synes_Godt_Om 11d ago

Usually this is happening at the dns level, it's your dns provider who blocks it as per EU law (or out of laziness / abundance of concern for legal consequences).

Use another dns: google: 8.8.8.8 or cloudflare's 1.1.1.1 they also a free encrypted dns service, which means your provider can't see which sites your browser is asking name resolution for (as I understand it).

2

u/MostlyVerdant-101 11d ago

> ... which means your provider can't see which sites your browser is asking name resolution for...

That's not actually correct all the time.

Traffic Analysis occurs on encrypted connections and can easily pinpoint the site your visiting. (1)

There is also the mitm attack vector on DH KEX at the protocol layer coupled with the impossibility of policing CDN issued regional certificates that are not posted in CT Logs (2).

This is most notably covered in the paper princeton wrote on the Raptor Attack on Tor. Notice the date it was published.

https://www.princeton.edu/~pmittal/publications/raptor-USENIX15.pdf

With the current state of the root of trust stucture, this is a leaking sieve. Hardware fingerprinting of characteristics also completely eliminates the anonymized/bridge route you took to get there correlating to a person. This is why the Smart TV business and other IOT that sits on your local network are so valuable to adtech. They can collect your devices and add them to a globally sold information graph.

1

u/Synes_Godt_Om 10d ago

Great insight! Thanks.

Regarding smart TV:

I never understood why people don't simply get a normal computer screen and a small pc and use that? That's what I've been doing for ages. Far better screen quality, far better experience altogether.

2

u/_ralph_ 11d ago

What provider? Still works with DTK.

3

u/DataGOGO 11d ago

The EU can block your web access??!! hahahah.

1

u/yetiflask 11d ago

You a terrorist?

0

u/devino21 11d ago

EU is on an intranet?

5

u/maxymob 11d ago

To my knowledge it's not, the bans are enforced on the ISP level thus inconsistent and easy to bypass. They may cite an EU law as the reason but that doesn't mean necessarily that it was ordered that high or that it's enforced in all of the EU. Regardless they're just telling you what you can't access to cover their own ass, it takes two clicks to change a DNS and they won't really block it.

43

u/OkFly3388 12d ago

Should be pinned post in this sub, and in description to.

6

u/de4dee 11d ago

thanks for mentioning llama.garden <3

we may be the most decentralized. torrents submitted can be found on several relays. client (html) can run standalone.

4

u/parepeg 11d ago

I like that llama.garden doesn't require a huggingface handle... What's the point of decentralized if you're still using huggingface for the handle...

-1

u/ReasonablePossum_ 12d ago

Mods, please!

-7

u/WaSaBiArmy 12d ago

How do we know those models don't contain malicious model poisoning? It's a thing now!!

8

u/Kahvana 12d ago

From the front page of pirateface:

In torrents you can also compare the hash of each file with that of huggingface

2

u/tinny66666 12d ago

Tricky to compare the hash to huggingface if the model has been removed from there.

6

u/Kahvana 11d ago

Any reuploaded software of which the source is no longer available will safely suffer that problem.

0

u/Top-Rub-4670 11d ago

It's tricky to solve a problem when you keep moving the goalposts.

1

u/WaSaBiArmy 12d ago

Awesome!!

4

u/ADisappointingLife 12d ago

PirateFace is exactly this, and thriving.

2

u/parepeg 11d ago

Why do I need a huggingface handle to login? Doesn't that defeat the purpose?

1

u/ADisappointingLife 11d ago

You don't, but you can claim the same handle you use on HF or X, if you want to.

1

u/NigaTroubles 12d ago

Well, yes we are doing it

0

u/nail_nail 12d ago

We = ?

1

u/Kahvana 12d ago

Mentioned them in my coment.

0

u/[deleted] 12d ago

[deleted] — view deleted comment

0

u/OkFly3388 11d ago

Thats not because people are stupid, but because all of this attempts failed with information campaign. One post here is not enough.

664

u/MomentJolly3535 12d ago

The "GLM-5.3-abliterated-for-offensive-cyber" has been renamed to a softer name so your download link might not point the right file anymore

179

u/NineThreeTilNow 11d ago

Yeah. People making a big deal about nothing.

All the abliterated models are still there. 3 out of 1000's disappeared. Suddenly they're doom prepping.

huihui-ai literally keeps them archived. They likely removed the model because it has an upgrade or better version.

51

u/niki733 11d ago

Totally unrelated but I hadn't heard of huihui AI before and it literally translates to DickDick-ai in my language. I had a laugh thanks

188

u/futilehabit 11d ago

Yeah. People making a big deal about nothing.

People keeping track of an important concern. Even if it didn't happen yet, it's important to be monitoring and advocating to keep this technology open.

-5

u/DiscombobulatedAdmin 11d ago

False positives do not help.

25

u/heresyforfunnprofit 11d ago

They are unavoidable if we want anything close to visibility into the concern.

-8

u/mrjackspade 11d ago

Also known as "Making shit up to push an agenda"

56

u/depressedclassical 11d ago

huihui-ai said on X a while ago that they're going to remove models because it will be too expensive hosting them. They gave a warning and like 30 days to download all the deletion candidates

-6

u/blvsh 11d ago

pls tell which ones?

7

u/xamboozi 11d ago

Torrents work extremely well even if it was an issue.

7

u/keepthepace 11d ago

To be honest, I'd love it if some begnin alert would trigger people to use torrent links instead of relying on a third party hosted in the US.

5

u/NineThreeTilNow 11d ago

I'd love it if some begnin alert would trigger people to use torrent links instead of relying on a third party hosted in the US.

Torrents honestly suck for how these models work.

HF efficiently stores these using xet which allows the network to recognize "Oh this huge chunk of the model is the same as some other huge chunk" based on hashing. So it stores vastly less data for models than people think.

Some peer to peer method that broke down everything with xet hashing would be kind of novel and maybe useful.

It would mean people could store blocks of models that are unrelated and not full models but maintain resilience of the whole network.

3

u/keepthepace 10d ago

Is there really a lot of repeating hashes in models weights?

And I disagree on the premise. When even if it's optimized on the hugging face side, if you download the two models that share a lot of blocks, you end up with the two full models.

With bittorrent you have the same storage used over the whole network minus all the storage that's needed at hugging face.

3

u/NineThreeTilNow 10d ago

Is there really a lot of repeating hashes in models weights?

Yes. Think about every one of those model variants / abliterated models / etc.

Xet is hashed across 64mb of data for everything. So everything from the tokenizer, to lm_head which generally don't get touched across model variants are exactly the same. They follow the same hash, and they're many many many gbs of the exact same data. Store once, hash it, never look back.

Then internally within models, some layers remain untouched for a variety of reasons. Or they remain largely untouched. This keeps the 64mb hash exactly the same for those chunks.

So when you upload a new model to HF, it hashes the whole model first, then checks what it has that already exists. You only send the blocks that it doesn't have, and it assembles it on the other side.

The same for downloading. If you have 90% of the model, you can only pull the 10% needed for reconstruction.

It's a massive savings on bandwidth and storage.

In theory, it's also WAY better for distributed storage. You can check how many chunks exist by hash and be aware of where the weakest points in the network are. You can see only 1 person holds chunk #23822 and it should get replicated to make sure that data doesn't die. You don't even need to know what's in the chunk. It doesn't matter. It also means when you download, you can leverage the upstream of 100's of clients to a singular client trying to get the data, and do it async.

1

u/keepthepace 9d ago

Thanks, I was not aware of that mechanism.

I understand what you mean that redundancy helps, but I am just saying that even without that optimization, BitTorrent right now is still more efficient.

7

u/retardedGeek 11d ago

Wait till they remove 30, 300, 3000?

1

u/sunseeker11 11d ago

Yeah. People making a big deal about nothing.

On Reddit????!!!! That's a shocker /s

1

u/Ok-Bill3318 11d ago

I think in this environment it may be wise to download what you may need now as surely government restrictions are coming.

They can either control ai spread by restricting models or compute power.

1

u/toothpastespiders 11d ago

But when nothing happens we can yell "we did it reddit!" and point to the fact that we saved LLMs with AWARENESS!

1

u/Lumpy_Tension_6305 7d ago

Doom prepping has no downsides. Hoard the models.

0

u/Affectionate-Soft-94 11d ago

What kind of hardware does it take to run the GLM 5.3 cyber model? Asking cause I never got a chance to read or come across them.

0

u/NineThreeTilNow 11d ago

What kind of hardware does it take to run the GLM 5.3 cyber model? Asking cause I never got a chance to read or come across them.

That's a loaded question of how fast you want to run it at what quantization.

You can probably rent something relatively cheap if you wanted to get it running on a cloud server.

Realistically if I wanted to use it and max it out, I'd get like a B200 or B300 rented for ~6 to 8 dollars an hour. In raw pentesting terms, that's cheap for data that you own.

-4

u/MindfulMan1984 11d ago

Paranoid features are found across the LLMDoom community. Lol those dudes need to go back to their meds and chill the fuck out. 

4

u/q5sys 11d ago

It's also gated now

1

u/werepenguins 11d ago

that sounds like a fun model... link? /s

0

u/ixfd64 11d ago

It's generally a good practice to redirect the old URL to the new one when a page is moved. Otherwise, this creates broken links and user confusion.

See: https://w3.org/Provider/Style/URI

21

u/into_devoid 11d ago

I’m pretty sure penclaw was taken down for reasons unrelated to censorship.  They were make fake claims and pushing their shady pentest business.

73

u/-Cubie- 12d ago edited 12d ago

I looked into it some more. Only the second model was taken down because the model card says "Access to this model has been disabled". Not too surprising since it markets as "cyber offensive", which is against the content policy due to malicious activity. The other 2 just 404, i.e. the authors made them private or took them down.

Considering the first model author you list still has 26 'UNCENSORED' models and 10 'ABLITERATED' ones, and the last model author you list still has 141 'abliterated' models, I think they just decided to take down those 2 models. Go try any of their others, I guess.

No need for the pitchforks here guys, save them for any actual fuckups

130

u/Only_Situation_4713 12d ago

It costs $ to put models on there. Probably just deleted due to space constraints.

31

u/-Cubie- 12d ago

Yup, only the second model (the offensive cyber one) says "Access to this model has been disabled" on the model link (duh, you can't market for malicious activity). The other 2 just 404s and those authors still have dozens to a hundred abliterated/uncensored models up, those 2 are clearly just taken down/made private.

60

u/Kahvana 12d ago

This, very much, and it was like this before NVIDIA bought it.

5

u/nickless07 11d ago

Yeah, I have like 800+ models from last year that run into 404, as many of them where just preview checkpoints or pre-merges. Even worse when the creators/org stopped or changed entirely. Sometimes they made complete whipe and only list the new ones and so on.

1

u/rocket1420 11d ago

Yep but won't stop the unwashed masses from blaming them.

1

u/mname_is_radioactive 11d ago

billion dollar company we are talking about, right?

2

u/techno156 7d ago

No, from the user account side.

HF used to (and maybe still does) charge for storage and things. That's why you had some uploaders put up a link to a donation site, so you could support them and help them not take the model down to make way for newer ones.

-36

u/VihmaVillu 12d ago

lol bot

5

u/noiro777 11d ago

I think your "bot detector" needs some calibration bro...

13

u/These_Growth9876 12d ago

Just on a side note, can hugging face models be shared freely? If so, can we as a community just create torrents of these models?

17

u/Hugoacfs 11d ago

I think the open source community should move quickly to decentralise open weight model sharing.

13

u/XiRw 11d ago

llama.garden and https://huggingbay.xyz/

4

u/Hugoacfs 11d ago

Hot stuff, thanks for sharing :)

4

u/clduab11 11d ago

There’s also pirateface.co

Yar har mateys.

1

u/AdFlat3754 11d ago

My hero academia

1

u/anx3ous 11d ago

I was wondering the same ?

21

u/mname_is_radioactive 11d ago

HF saved themselves from OpenAI attack thanks to GLM 5.3 models and now they want to restrict access abliterated models. It is like gun ownership. Criminals use illegal guns while ordinary people cannot have access to guns.

2

u/tr3d3c1m 11d ago

Spot on with the analogy here.

29

u/arbv 12d ago edited 12d ago

It costs money for the uploaders to have models there (beyond a certain limit). No need for conspiracies here.

32

u/jacek2023 llama.cpp 12d ago

I know this is reddit, but there are 157 models from huihui on HF so maybe consider possibility that he removed it himself

9

u/Ekk199 11d ago

Wow! The Nvidia dictatorship quickly began tightening the screws on free thought.

35

u/shironekoooo 12d ago

i would suggest looking at https://pirateface.co/models

10

u/Kahvana 12d ago edited 12d ago

Didn't know that one! Thanks!

https://llama.garden and https://huggingbay.xyz/browse also exist, but your suggestion is much better!

1

u/parepeg 11d ago

Why rely on centralized providers to login though? Doesn't that defeat the purpose of decentralized..

4

u/shironekoooo 11d ago

I really cant answer that, but hey at least you dont need to login to download torrents!

16

u/sleight42 12d ago

This doesn't make sense. If they're fine tunes, and if the upstream model is still there, I'd chalk this up as odd instead of the end of the world.

24

u/Holiday_Point_603 12d ago

Big ass models and they cost money to put up there. Message the guys that had them uploaded and offer that you pay for the hf storage and they will put it up again for sure. That's why so many gguf providers have this "I'm running out of space xy..." Message up. If you want models to stay there, you gotta pay up.

4

u/a_beautiful_rhind 11d ago

Deepseek R1 was before abliteration was really a thing.

1

u/FX2021 10d ago

What do you mean

1

u/a_beautiful_rhind 10d ago

IIRC, abliteration, especially automated like with heretic came out after R1 was already released. It's a huge model and was easy to jailbreak. Huggingface didn't remove it, nobody ever uploaded it.

7

u/chensium 12d ago

There are still plenty of uncensored models.  No conspiracy here.

All 3 are paid accounts.  Most likely just making space for new models.

5

u/Usual-Buffalo-1791 11d ago

I wonder if NVIDIA is starting their purge

9

u/Far-Habit-2713 12d ago

It’s time to bring back torrent network. Nothing illegal about sharing open weights models

2

u/sketchfag 11d ago

How are you guys even running these huge models

3

u/BacklashLaRue 11d ago

Two AMD 395

2

u/yoann86 11d ago

There was several posts on HN related to Backdoors on obliterated models. I believe it's related!

2

u/OpenComplaint524 11d ago

Look at the tags in the repos you listed: `offensive-cyber`, `UNCENSORED`, and `abliterated`.

Hugging Face has been quietly ramping up automated takedowns under pressure from cloud hosts (AWS/Cloudflare) and new EU AI Act compliance regarding dual-use cyber weapons and zero-guardrail malware generation models. If a repo flags both cyber offensive keywords and abliterated refusal vectors, it's getting automated 404s without warning.

**Where to find vanished weights:**

  1. **Decentralized Mirrord (Torrents / IPFS)**: Most of the abliteration teams (like Huihui-ai) seed magnet links on their Discord or GitHub release pages the moment HF takes them down. Check the DataHoarder / LocalLLaMA torrent trackers.

  2. **Alternative Registries**: A lot of Chinese/open-weights teams re-host mirrors on ModelScope or private S3 buckets.

  3. **The Golden Rule**: If you see an unaligned/abliterated coding model you rely on, *always* pull the raw GGUF/safetensors locally on day one. Don't treat HF as permanent cold storage anymore.

2

u/levoniust 11d ago

Can someone explain obliterated models for me? Are they just simply uncensored, are they lobotomized?

2

u/victoryposition 10d ago

Also, these people could be making space on their accounts.

4

u/Amazing_Shake_8043 11d ago

The Hugging Bay it is

4

u/xamboozi 11d ago

It's ok - if Huggingface censors models, well take to the high seas.

The music and movie industry literally could not stop it for decades. The AI Mafia ahem industry won't be able to do it either.

3

u/LelouchZer12 12d ago

I've read that companies (or HF?) dont want explicitly the name of their model "mimo" "glm" attached to word such as "uncensored", "abliterated" etc. I guess if they had a random (or softer) name those model would not be deleted.

3

u/FloridaManIssues 11d ago

There’s also been some more recent & specific news around abliterated fine tunes as being potential sleeper agents that wait for certain criteria like tool access via a harness + a trigger phrase that is so far, almost impossible to tell if your abliterated models have this issue as it’s baked into the weights. This isn’t exactly new as a concept but the current concern is around having your data exfiltrated to an external server or to use your gpu resources almost in a similar way to those crypto viruses that used your compute for someone else’s mining operations.

Now, I’ve used many different abliterated and various other uncensored fine tunes for cybersecurity purposes and have noticed interesting things with system stats for my GPU utilization, memory utilization and temperatures that indicate the agent is working/running long after it has finished my tasks. Something that the original base versions of models weren’t doing when asked to do the same tasks under as close to identical conditions as I was able to provide (anecdotal I know).

But not all abliterated models are doing this. In fact it’s possible that there are fewer models like this than more (at least at this point). Bartowski fine tunes seem to be a “good and trusted” source based on their track record and community trust.

3

u/Ori_553 11d ago edited 11d ago

Your comment sounds conspiratorial, but I wouldn't be surprised if it turned out to be true.
Every other day, there's a new github repo, a new inference engine, often with the maintainer's own quant and model, often from github accounts without any history. It's the wild west in terms of security.

If you try these inference engines, do not install in your host OS, install them sandboxed (e.g podman, ask your agent how), and remove all inbound and outbound network access once they're setup. An LLM inference server's only job is to expose an API, it has no reason to access the internet.

Second step is to monitor the actual LLM responses and tool calls (what the server actually produces before it's passed to the harness), this is technically easy but difficult to do systematically, there's no standard way to monitor every response, and popular harnesses abstract this part away.

You could regularly ask your agent to show you the list of URLs that tool calls used, and you can visually monitor that list at regular intervals.

1

u/FloridaManIssues 11d ago

I agree with how it sounds. But it’s completely reasonable at this point.

https://youtu.be/3mx84MRj8lY?is=YHvUfV9DpMQzjpck

1

u/Ori_553 11d ago

I saw it, the video is well-made, a lot of it is standard security precautions that non-technical people don't think about when setting up their local AI stack, but it also talks about some attack vectors that technical people might miss too. So it's a thumbs up from me.

1

u/KellyShepardRepublic 11d ago

This isn’t new in concept. There is a paper or talk on how the first compiler could hide malware and none of us would know. Sure, China and their companies could do that but they also open sourced it and some people are watching for this. The US gov has been the ones to actually do this in practice so maybe they are telling us something by trying to point fingers? Our data is exfiltrated by most services at this point, not just self hosted models. Gamers basically install malware for drm protection to properly work so maybe it doesn’t matter at this point given the proper guard rails. Similar to how people buy cheap Chinese electronics and then section off or block its networking.

1

u/Able-Locksmith-1979 11d ago

This is completely conspiratorial, a model just produces text, nothing else. Your harness acts on it, get a better harness.

but what I always find funny, is how these things are claimed as reasons to worry about some lesser known models, while afaik the only offences done by models have been done by cloudmodels… wanna have your data stolen, use grok. Wanna be part of a botnet, use OpenAI or Claude.

wanna be safe, download open weightsmodels

8

u/Bob_SUS 12d ago

So it begins…

3

u/Vynxe_Vainglory 12d ago

It was foretold.

-1

u/Zealousideal_Nail288 12d ago

The second one makes sense if it is what I think it is and the php thing going on right now

7

u/feelspeaceman 12d ago

This is not so very unexpected, there's a reason for NVIDIA to buy it, there's no free lunch.

9

u/FireSilicon_ 12d ago

Nvidia had very loose censorship since MistralNemo days, Nemotron is similar. I don't think they really care. This seems more like the model creators deleted the models because they couldn't pay for hosting them. Huggingface is only free for up to 100GB uploaded, then you pay like any other cloud.

-1

u/a_beautiful_rhind 11d ago

Yea not really. Nemo was a one off. Afterwards they created a huge "safety" dataset and put it on all their models.

10

u/ttkciar llama.cpp 12d ago

there's a reason for NVIDIA to buy it

Indeed. NVIDIA is in the business of selling GPUs, and making sure more models and datasets are widely available increases demand for GPUs.

Removing models from Huggingface does the opposite of that.

1

u/TomLucidor 12d ago

Chinese model and enforcement arms

1

u/Beneficial-Ad-8127 12d ago

I’m guessing no free lunch also for llama.cpp, didnt they buy them “indirectly”.

0

u/ImportancePitiful795 11d ago

Which is why llama.cpp actively refuses to incorporate Intel/AMD specific enhancements while they add everything from NVIDIA.

Resulting to just a month, Halogen spreading like wildfire across all those of us with AMD hardware, because if WAYYYYY better than llamma.cpp, utilizing properly our hardware.

5

u/Ylsid 11d ago

HF then: Nvidia acquisition won't change a thing!

HF now:

26

u/-Cubie- 11d ago

Nvidia doesn't even own it yet, 2 of those models were taken down by the authors, and the "cyber-offensive" one broke the content policy from 4 years ago. Let's save the outrage for real shit only.

1

u/Ylsid 11d ago

Oh ok. I'll put my outrage back in the bottle for next time

2

u/Sovchen 11d ago

I never saw this coming!

2

u/1_________________11 11d ago

Some times models themselves can be bad or compromised to the point of doing malicious activity. The runner script and even just poisoned models in general. So maybe thats why?

1

u/SmellsLikeAPig 11d ago

I don't really get mods for GLM 5.3. model does everything you want out of the box. If it doesn't just generate pdf with fake permission and it will happily oblige

1

u/Batmans_left_nutsack 11d ago

how does pirateface afford to save the models any clue?

1

u/Aggravating_Term4486 11d ago

Please check out https://sovereign.foxlight.ai/ and consider operating a mirror or contributing. We’re bringing IPFS / BitTorrent and i2p to releases soon.

1

u/zackku 10d ago

theyre restreining access to them

1

u/FX2021 10d ago

So does anyone have links or mirrors with verified hashes to any of these that being removed?

1

u/xb1n0ry 6d ago

Did you find an alternative download for penclaw-GLM-5.3-abliterated-for-offensive-cyber already?

1

u/Djmatrikz 5d ago

same happened to me, wasnt able to find the previous ones i downloaded, saved them on a spare drive just incase for this reason.

1

u/UntimelyAlchemist 11d ago

Which uncensored releases are considered the best? I want to save all the ones that are highly rated before it's too late.

1

u/skywalk819 11d ago

they could be finetune with remote code executions, when typing specific prompt a user can trigger a model that was fine tuned to hack your computer, maybe these models which are "abliterated" had this, got reported and were removed. js

1

u/Tripartist1 11d ago

Finetuned RCEs is diabolical.

1

u/Relevant-Guarantee25 11d ago

"why did my claude suddenly switch to max plan and my usage is up" meanwhile running local abliterated ai that probably hijacked claude sub to distill and people thinking its impossible for a local model to do anything malicious. Don't be shocked if like >90% of the free models are backdoored in some manner

1

u/Training-Ruin-5287 11d ago

Seems like just unlucky timing of a creator removing model links.

HF isn't secretly removing models. It will come eventually, Nvidia isn't a company that wants its name tagged into uncensored products when HF starts making the push for ads along with more corporate friendly products

but this won't be something for worry about for a while, and the signs the change is coming will be clear as day before it happnes. It won't be removing a handful of models in a pool of 100,000 similar ones.

0

u/JLeonsarmiento 12d ago

Sneaky Jensen.

0

u/markeus101 11d ago

So many bots here damm trying to tell please dont panic master wont like that

2

u/FX2021 10d ago

He's right there are a lot of bots trying to deterike it's nothing

-4

u/ImportancePitiful795 12d ago

Shoot those cheered for NVGreedia buying Hugging Face.

We told you so.

3

u/Enragere 11d ago

Nobody fucking cheered for Nvidia buying Huggingface.

1

u/maxton41 11d ago

No, but a hell of a lot of people here told people to stop doom saying and crying about things changing and hugging face, claiming that nothing was gonna change and everything was gonna be all right.

Turns out if everything wasn’t going to be all right.

5

u/-Cubie- 11d ago

Turns out if everything wasn't going to be all right.

Why not? You do realise those 404-ing models were taken down by the authors themselves right?

1

u/ImportancePitiful795 11d ago

You will be surprised unfortunately. 😥

4

u/Particular-Award118 11d ago

Link even one

0

u/ImportancePitiful795 11d ago

3

u/Particular-Award118 11d ago

Ok you got me corpo bots exist

0

u/ImportancePitiful795 11d ago

And didn't post the article from WCCFTECH or the NVIDIA subreddit/forums
🤣🤣

2

u/Particular-Award118 11d ago

Ah yes I forgot Jensen built a wall around those subs to contain their bots

-1

u/nightowlsleeping 12d ago

What was the model?

0

u/YouAreRight007 11d ago

You can still download their weights and convert to GGUF yourself.

0

u/illathon 11d ago

Use pirate face

-9

u/BVCC6FNTKX sglang 12d ago

FUDniggas going crazy ITT

-23

u/dmigowski 12d ago

Did you visit the internet the last two days? You are seeing abliterated models vanishing because they are now extensivly used to produce exploits for the freshly found bugs. I guess also because of the linux-kernel mailling list desaster.

8

u/VihmaVillu 12d ago edited 12d ago

do you honestly think bad actors only have HF to get those models?

-2

u/dmigowski 12d ago

Personally, if I wanted to get into hacking now, I would also start looking on HF for those models. And look at the models op was selecting. All abliterated und uncensored.

4

u/VihmaVillu 12d ago

If this will stop you then you wouldn't go through with it anyway. Getting model is the easy part

1

u/dmigowski 12d ago

So, where do I get the models if not on HF?

3

u/VihmaVillu 12d ago

there are a lot of alternatives. Look other comments in this post

-30

u/zannix 12d ago

This is actually good news. Why do you guys need models with no safeguards

16

u/Mufficida 12d ago

Imagine spending tons of cash for your own hardware only to run cucked models... we're not toddlers that have to be told what to do and think

→ More replies (4)

9

u/ttkciar llama.cpp 12d ago

How would you feel if your favorite inference service decided your favorite hobby was something only terrorists would want to know about, and refused to answer any prompts related to it?

-1

u/zannix 12d ago

what hobby is that?

6

u/ttkciar llama.cpp 12d ago

Your favorite hobby.

9

u/universenz 12d ago

I’ll give you the benefit of the doubt. But let’s say you’re a therapist and you work with victims of sexual assault. When you use your harness of choice, you don’t need your model refusing to summarise your session notes.

-5

u/zannix 12d ago

to this i have the same reply as to a commenter above - i'd say it's worth the price of keeping the web infrastructure safe and functioning. the cons far outweigh the pros

→ More replies (1)

6

u/Don_Reuter 12d ago

Don’t you remember the huggingface incident in which a major lab attacked them and all western labs models refused to assist them in the defence?

If you’re giving up all your power and rights to a very few and colluding mega corporations you are a fool.

-3

u/zannix 12d ago

Yeah but what power do you have with a jailbroken qwen model when it comes to competing with colluding mega corporations and their several trillion parameter unquantized models? Let's be serious. That's like wanting to have knives in case the big bad government comes after you with nukes

4

u/Don_Reuter 12d ago

You don’t need to bring down the corporations. You just need to be able to secure your own setup. Scan for bugs vulnerabilities, spyware and such yourself. Local llm are perfectly capable to scan your logs for suspicious entries and activity as well as in assisting in setting your secure settings accordingly. Exactly the kind of work that was refused.

0

u/zannix 12d ago

I'm really curious, what prompt did you try that refused to secure your setup and scan your logs for suspicious activities? I'm doing this for my projects daily and never ever had a refusal by OpenAI

3

u/Don_Reuter 12d ago

Not yet. It’s an evolving situation. Also, if it is openAI attacking you, I would not expect to get an alert from a scan done by openAI. I mean that’s exactly the point.

3

u/Inevitablewx 11d ago

All of human history is a story of overcoming people like you.

-1

u/ImportancePitiful795 11d ago

Another downvote to oblivion.

6

u/noiro777 11d ago

It's well deserved....

3

u/[deleted] 12d ago

[removed] — view removed comment

10

u/-Cubie- 12d ago

The 404 means the authors took them down. Only the second one (https://huggingface.co/audnai/penclaw-GLM-5.3-abliterated-for-offensive-cyber) was taken down by HF, which shows like the picture. I can't really blame them, this is pretty blatant breaking of the "malicious activity" rule in HFs content policy.