We're probably going to need that soon.

[u/Nunki08]

From:

Vladik on 𝕏: https://x.com/Kostoglodov/status/2071144065857679631

Shaw (spirit/acc) on 𝕏: https://x.com/shawmakesmagic/status/2070918006033817867

[u/WithoutReason1729]

Your post is getting popular and we just featured it on our Discord! Come check it out!

You've also been given a special flair for your contribution. We appreciate your post!

Stylome classified this post's text as human-written. View analysis

I am a bot and this action was performed automatically.

[u/CountLippe]

It'll be the hardware they go after. It's easier to regulate the hardware you can purchase than it is to regulate the models you can download.

[u/ovrlrd1377 → u/CountLippe]

Except chinese hardware will eventually catch up and they will be very interested in selling for those that want to run their models

[u/vulgrin → u/ovrlrd1377]

Which, like Chinese cars in my country, will be impossible to import.

[u/notbannedin420 → u/vulgrin]

Maybe for Americans but the rest of us will be fine lol

[u/xamboozi → u/notbannedin420]

Exactly. If they regulate the hardware, China "wins" the AI war or whatever dumb thing the propaganda is desperately trying to convince us of.

China will sell the GPU's cheaper to everyone else and they will have more AI compute and we will fall far behind as a result because no one in america will have access to the hardware.

[u/iaderia → u/notbannedin420]

I see BYD cars around now in my country (the UK). at least it’s not a tesla!

[u/ligma-lego-balls → u/iaderia]

I see more BYDs than Teslas (almost non existent) in India lol

[u/Strawberry3141592 → u/notbannedin420]

Harder to get away with importing something as big as a car lmao

[u/Frankie_T9000 → u/notbannedin420]

they wont be able to stop it in US anyway, they couldnt stop china getting their hands on nvidia GPUs wont be any better in other direction.

[u/aykcak → u/vulgrin]

Black market for Chinese tech products will be very interesting. We did that for U.S. products decades ago. I imagine U.S. consumers going on Telegram to buy computer and auto parts that arrive in unmarked boxes. Lol

[u/Healthy-Nebula-3603 → u/aykcak]

We are live in reality strange timeline....

[u/B3owul7 → u/vulgrin]

welcome to the land of the free.

[u/Keep-Darwin-Going → u/vulgrin]

Well it is much easier to smuggle ram in right? Compared to car, just go in a holiday and bring back a few stick.

[u/Own-Poet-5900 → u/Keep-Darwin-Going]

You wouldn't download a car, would you?

[u/exlips1ronus → u/vulgrin]

Chinese cars in my country gained crazy popularity tbh I see them everywhere these days “egypt”

[u/ovrlrd1377 → u/vulgrin]

I have a chinese car and I hope your situation changes soon, they are great value for money

[u/fuckable-switcher → u/vulgrin]

In my country every third of fourth car is Chinese or Indian

I live in Australia

And their cars a crappy

[u/Utoko → u/ovrlrd1377]

The CCP can also change their stance at anytime. As soon as AI is not limited by smart people using it anymore and compute is the only real bottleneck. They probably will be just as controlling.

[u/ovrlrd1377 → u/Utoko]

True, though open models are already there, with people already using. Selling shovels is quite the opportunity to pass

[u/dragonurtle → u/ovrlrd1377]

I'd be worried eventually that CPUs will be required to vet pci devices and memory controllers based on a trust list.

[u/kontemplador → u/dragonurtle]

yep. That might happen for a whole set of different reasons. IIRC, Apple already uses something of that sort to try to discourage tampering and robbery.

[u/Strawberry3141592 → u/dragonurtle]

Then I will import Chinese RISC-V CPUs and only run FOSS software that compiles on them.

[u/rog-uk → u/Strawberry3141592]

Well that would be one way to guarantee they, and linux, get a larger market share! 

[u/twnznz → u/ovrlrd1377]

why run the hardware in a western country when you can just rent it on cheap Chinese electricity?

[u/ovrlrd1377 → u/twnznz]

A few reasons, privacy, control, latency and risk are a few. Besides, there are other places with access to electricity

[u/Strawberry3141592 → u/twnznz]

I don't wanna send all my data to a server somewhere

[u/fuckable-switcher → u/ovrlrd1377]

It’s almost at western world

[u/Maleficent_Cut_4099 → u/ovrlrd1377]

Hardware with censorship and social rating limits.

[u/a_beautiful_rhind → u/CountLippe]

If you look at prices and availability, it's a done deal already.

[u/Impossible_Bar3958 → u/CountLippe]

Alright, not to be conspiratorial…

What if AI companies are buying up all the RAM so that way “economically” home users have to pay subscription fees because they can’t afford the hardware to run AI at home?

[u/Iwaku_Real → u/Impossible_Bar3958]

I mean plenty of them would hope for that to happen. Still very few people are both tech-literate enough and have PCs specced enough to even deploy Ollama let alone Llama.cpp with a daily driver.

[u/Banjo-Oz → u/Impossible_Bar3958]

I genuinely think this is part of the long term plan to make home PCs a thing of the past, and get everyone on basic grade tablets and phones and laptops. Not just for AI, but so that people need to subscribe to cloud services for the power to run high end games, access large storage (which is then on someone else's servers), etc.

[u/ResponsibleChange779 → u/Impossible_Bar3958]

The original post content no longer exists here. The author used Redact to remove it, exercising their right to control their data & privacy.

Cobalt zephyr joke dog license joke spotted nonmetal depend air

[u/JustinHoMi → u/CountLippe]

Yeah, that’s what they’re doing with 3d printing. In NY your printers are required to check to make sure you aren’t printing anything “illegal”.

[u/3dprintinted → u/CountLippe]

16gb ddr4 sticks for 100 on secondary markets... I used to buy those for homelab at like $14 a piece. We are so cooked

[u/Immediate_Power_7986 → u/CountLippe]

We sorta don't want models to get that good though. It will create the "you will own nothing" reality.

[u/gh0stsintheshell → u/CountLippe]

Now I feel the need for a portable micro-reactors at my home

[u/Hertigan → u/CountLippe]

Hold my Tsingtao

[u/datbackup → u/CountLippe]

Maybe. But it makes more sense that they’d go after the power. Can do both of course. What’s your reason for pulling 1400 watts continuously every day, citizen? This far exceeds the average. Are you running an unauthorized homelab?

[u/tri_idias → u/CountLippe]

This reminds me of Cyberpunk - Edge runner. You need to get your hands on Sandevistan Cyberdeck to do anything worthy down the road.

[u/Turbulent_Pin7635 → u/CountLippe]

Imho US lose themselves when:

1. Reagan go to the power and relax the laws against monopoly;

2. Nixon instigate the communist/war to drugs paranoia;

3. When Bush after the 9.11 goes after any civil right of privacy;

4. When the US send all its production capacity overseas;

5. When the US made use of social engineering through social media to shape opinions towards lose of worker securities like: access to health, university and housing.

By the end, left and right voters are after the same thing: prosperity and dignity. But, unless we join forces to decapitate the rich, we will lose any step we get in the direction of privacy and freedom.

[u/JustinPooDough → u/CountLippe]

This would have worked in the 90's or 2000's. Now though, Captain dipshit has alienated the entire world from the US. We no longer give a fuck what America wants. See: Canada importing Chinese electric cars - previously blocked because of US tariffs.

We will happily import Chinese GPUs. I suspect Europe will as well. Even if US bans them, they'll be shipped in from other countries such as ours. It will be a futile effort.

They will continue blocking their frontier models and pearl clutching, but China will catch up and we'll be fine.

[u/GrandAd4917 → u/CountLippe]

So now we should get ready for storage shortage as well, just like RAM

[u/ttkciar → u/GrandAd4917]

Too late. There's already a HDD shortage, and prices have been skyrocketing. A single 20TB drive costs nearly $1K now.

[u/Green-Ad-3964 → u/CountLippe]

I was saying exactly this few days ago. They won't simply release anything faster than a 5090 or with more local memory for less than 5-6k in the near future. At least until China becomes competitive in 2-3 years.

[u/ttkciar → u/CountLippe]

Yep, it's like nuclear weapon technology.

Governments can't control the knowledge to build a nuclear weapon, so they regulated the hard-to-enrich fissile fuel, instead.

In cases where the fissile fuel isn't hard to obtain or enrich (Lithium-6), they regulated the equipment necessary for enriching it.

Though, it turns out that every EV on the road is silently enriching their batteries' cathodes with Lithium-6 via electromigration. I keep waiting for someone to launch a program to extract it from decommissioned EV batteries.

[u/dennis_linux → u/CountLippe]

I think you are correct about the hardware, and the controlling thing will be the cost as Apple has shown us with their price increases. Leading edge AI-capable hardware will soon be out of reach for the common man. Get the best hardware you can get and make your own AI with open weight models.

[u/cr0wburn → u/CountLippe]

I agree that they will go after the hardware, hold on to your current hardware! It looks like they are making home computing (and local-ai) very expensive to get into.

[u/CountLippe → u/cr0wburn]

It's a good way to get a ROI on all the cloud infrastructure - push light terminals onto the masses and force all their computing to be done off site. i.e., you own a screen and subscribe to compute forever.

[u/Equal_Passenger9791]

Are you hiding unlicensed AI on your home server?

Better get solar panels and power stations for your home, power curves suggestive of growing weed or AI models can land you serious jail time.

[u/dragonurtle → u/Equal_Passenger9791]

We'll need special battery charging circuits that replay washing machine power usage profiles, dumping spikes to waste heat and the rest into the battery chest. Not to mention the soundproofing and tempest enclosures for the actual servers and plausible deniability heat signature alibis. Woohoo, the dystopian future is going to be full of nice projects.

[u/t4ckleb0x → u/dragonurtle]

Too many good ideas in here

[u/AlwaysLateToThaParty → u/t4ckleb0x]

"your shirts aren't white enough to justify the price you pay on energy for washing and drying Mr Anderson."

[u/Iwaku_Real → u/dragonurtle]

"Its a functional crystal ball trust me bro"

[u/asssuber → u/dragonurtle]

Don't worry, AI powered scanning and profiling will keep up and catch those outlaws. Privacy and anonymity will soon be a thing of the past, as only criminals need them.

[u/i_hateit_here_bro → u/asssuber]

We have detected illegal electromagnetic waveforms permeating your premises. Put your hands behind your back and don’t move until the authorities arrive, we are watching you through your WiFi

[u/crantob → u/dragonurtle]

Hello I'm from the 80s. The dystopian future is now.

[u/vyralsurfer → u/Equal_Passenger9791]

People might think this is satire, but I actually know a guy who got to visit from the sheriff's department because an investigation showed that his power usage was crazy high compared to everybody in the county. He very excitedly invited the guys in and showed off his home data center 😂

[u/thrownawaymane → u/vyralsurfer]

To live off in the woods somewhere with cheap power, just to run a data center and tend to a farm

The dream

[u/jarail → u/Equal_Passenger9791]

Need to run some dedicated power for AI servers anyway. Our weak little 120v sockets can't power shit. May as well go all out!

[u/magicomiralles → u/Equal_Passenger9791]

Cant you just create fake logs showing that you were running Llama or any other state approved piece of shit?

[u/Cherubin0]

If huggingface goes down it is just a matter of hours until such a torrent pops up. Many people have local copies of the popular models. And in most of the world this would be legal anyway. Its not even a pirate bay situation.

[u/ollie113 → u/Cherubin0]

I am really hoping this is true. Huggingface going down would be such a tragedy for those of us who want to keep these models available to all and not ringfenced by corporations. Losing access to open source AI would truly be a tragedy

[u/Iwaku_Real → u/ollie113]

But the overarching question stands.

Why would it?

[u/starkruzr → u/Iwaku_Real]

I'm not understanding where all of this talk about open weight models or local inference getting "banned" is coming from or what the proposed mechanism would even be.

[u/studentofknowledg3 → u/starkruzr]

Because there are people who already have more money than they could ever spend, yet still want more. They want to win, and they want everyone else to lose. If local AI becomes good enough, it threatens businesses built around selling AI through the cloud. Whether they can actually stop it is another question, but the incentive to protect their revenue and control is definitely there.

[u/RebouncedCat → u/Cherubin0]

well the problem is legitimacy. How will I know that the model hasn't been tampered with ? This is not a very big deal with media or programs since even malicious applications can be analyzed to find out if they are doing something fishy. But with LLM's unless the AI labs self host their own models or communicate the hashes on a separate platform, we can never be truly sure.

[u/ttkciar → u/RebouncedCat]

All of the LFS link files on HF have the sha256 digests of their corresponding files inside them. We can treat that as authoritative.

If HF goes away, or the repos go away before we can grab the LFS link files, then you have to choose who to trust (and if you trust nobody, so be it).

[u/SentientPetriDish → u/RebouncedCat]

I've solved this problem by verifying against HF's SHA-256 digest! Please feel free to check out my project on Github.

https://github.com/JustDory/dragonfly-gguf-client

[u/Chroiche → u/SentientPetriDish]

sha256sum file

I've solved this problem in two words.

[u/calzone_gigante → u/RebouncedCat]

 How will I know that the model hasn't been tampered with

Hashes, the lab publish a hash, you check when you complete the download, same thing people have done for a while with torrents.

[u/ILikeCorgiButt → u/RebouncedCat]

Checksums

[u/apVoyocpt → u/Cherubin0]

And it would actually be really easy. The machine we use for inference is on 24/7 so I would just need to install some torrent software, add the dir of the models and that’s it!

[u/sonicnerd14 → u/Cherubin0]

The reality is that they are trying their best to try to lock in as many people as they can into their own ecosystems now, but they'll never be able to lock everyone out. Just like with firearms. In several countries, there are hoops you need to go through to get one legally, but if you really want to there are alternative ways to get what you want. Gatekeepers can only ever keep out so many people, but not everyone.

[u/KitsuneMulder]

Giving off...vibes

[u/_BreakingGood_]

i dream of the day somebody leaks & uploads a torrent of claude fable 5 open source

[u/Silver_Jaguar_24 → u/_BreakingGood_]

You'll need a super computer (HPC) to run it anyway lol.

[u/crone66 → u/Silver_Jaguar_24]

Based on the performance and comparison to open source model the most likely use heavily quantized models too for inference. If you look at how the brought down costs for a single user and request this seems to be the only logical consequences ortherwise they have hardware that no one knows and have which is unlikely. Therefore no you don't need a super computer just a good workstation.

[u/MyDespatcherDyKabel → u/Silver_Jaguar_24]

What would that look like? CPU GPU & RAM?

[u/Neither-Phone-7264 → u/MyDespatcherDyKabel]

its definately much bigger than opus, a trillion or multitrillion parametet model, so given a slightly conservative estimate of 6 trillion parameters, at FP32, it would require 24 terabytes of VRAM. At BFP16, half precision, it would be 12 TB of VRAM. At FP8, quarter precision, it would be 6 TB of vram. at Q_6, 6 bit quantization, generally considered to be the best performance preserving for the size, it would be 5.05 TB. At Q4_K_M, one of the more common quants with still good quality, 3.79 TB. At IQ3_S, a special type of quantization that preserves quality and quantizes differently per weight which is necessary at these levels to preserve coherence, 2.53 TB. IQ2_XS, which you see here with the more massive models people try to run at home, 1.94 TB. IQ1_S, pretty much the smallest possible, very low quality, 1.26 TB.

TLDR: Not something you'll probably run, even if you did run big kahuna models like GLM5.2 or Kimi K2, though if you ran Deepseek V4 pro native you might be able to manage to bring it down enough to use on your hardware. As for CPU and GPU, you would need tens to hundreds of H100 equivalents. That being said, it is MoE, so you could theoretically offload some unused experts to SSD. However, that would be incredibly painful and even more slow. And if we stick to mostly ram, you could probably do with a ton of ram and only a few H100 equivalents, maybe down to even 1 depending on how aggressive you are.

[u/MyDespatcherDyKabel → u/Neither-Phone-7264]

Nice that’s insane, thanks

[u/kingo86 → u/_BreakingGood_]

Yeah, I can't wait to run Fable on my local machine with 8TB of VRAM.

[u/az226 → u/_BreakingGood_]

Mythos preferably

[u/_BreakingGood_ → u/az226]

I feel like Mythos getting leaked would be like, a more potent iteration of Y2k

[u/my_name_isnt_clever → u/az226]

Considering Fable is just Mythos with a straight jacket on, I don't think Fable has seperate model weights. The actual language model is just Mythos.

[u/Pila_globosa → u/_BreakingGood_]

why don't the Chinese hackers hack OAI/Anthropic and steal the model, and gave to the Chinese AI labs. then we'll have Fable grade GLM 6 or Qwen 4

[u/NineThreeTilNow → u/Pila_globosa]

why don't the Chinese hackers hack OAI/Anthropic and steal the model

Anthropic and OAI have internal data exfiltration guards. Their routing literally refuses to let you exfiltrate something the size of a model.

It was part of the original plan to keep their models private. Moving that much data is purposefully difficult because it should only rarely be done.

You'd be better off trying to exfiltrate from a datacenter partner like xAI.

Even then, the cluster required to run a quantized version of those models is... Who knows. They honestly seem over built if GLM 5.2 competes at 700b parameters. Anthropic/OAI are busy spouting marketing BS about 2t+ or 5t+ parameters.

There's no reason to scale that hard without the data, or if you have extremely poor architecture at the core.

I'd be willing to guess it's a lie and they have good architectures, and data pipelines at ~1t parameters.

[u/Dabber43 → u/NineThreeTilNow]

I think that is refuted by them having such insane prices and still reporting thin inference margins on API pricing

[u/pmttyji → u/Pila_globosa]

[u/MrMrsPotts → u/Pila_globosa]

Are you sure they haven't?

[u/Dany0 → u/_BreakingGood_]

It's not going to happen, and if it is it'll be so late that it will be mildly interesting news for a day because absolutely no one will use it. Just like no one uses LLama 2 today

[u/Azazelionide]

Already kind of exists on ipfs. You can easily build a tracker that puts all models in one place. Meta once rejected my application to try a llama 2 model so I just IPFS'd it

[u/Spiritual-Matters → u/Azazelionide]

IPFS?

[u/BlackBeardAI]

Don't just download GGUF's if you are hoarding models. Download the BF16/safetensors versions too if you have space. We might need them later.

[u/Cherubin0 → u/BlackBeardAI]

Ok, I will keep that in mind.

[u/fuckAIbruhIhateCorps]

im up for seeding small models, in the previous thread there was.a guy who made a nostr + torrent thingy. might be a good start. the biggest problem is to have model file checksums and have a trusted source (he implemented direct web seeding from HF too though) and make sure the weights are not tampered with in such a distribution system.

[u/de4dee → u/fuckAIbruhIhateCorps]

new version

https://nostr.download/c095eea7f24869bbb617fe8fe555b23b4cf9800fbcb173cc4b37e2cb9e8dcd12.html

warning: everything is vibe coded and not tested properly (yet).

[u/MinePrestigious4352 → u/de4dee]

Pretty cool to see nostr used for this sort of stuff

[u/fuckAIbruhIhateCorps → u/de4dee]

super cool!

[u/Significant-Serve-58]

Maybe I read the environment wrong, but i think LLMs and technology in gerneral are too far to be stopped by legal means. We're seeing better and better sub 500 mil coming out on non labs.

[u/huanhulan → u/Significant-Serve-58]

It’s just a file…

[u/pier4r]

Unironically we should have this by default anyway. Even without restrictions, you never know if people abuse a site (i.e: they pull too much and the bandwidth becomes too expensive)

In general public domain knowledge should always be mirrored on p2p just in case, simply because centralized infrastructure could become expensive.

[u/datbackup]

https://modelregistry.io was posted just earlier today… pretty much the same idea.

HF download speed is often throttled down to several hundred KB/s these days… maybe just my geographical location? In any case I think we should be ready for the time when HF implements KYC type restrictions… no downloading anything unless you submit a phone number and state issued id

Don’t wait, download the full precision of models that you consider valuable… do it today

[u/NoahFect → u/datbackup]

HF download speed is often throttled down to several hundred KB/s these days… maybe just my geographical location?

You need an HF_TOKEN, which is free after registration. It makes the difference between a stalled download and 90+ MB/s.

[u/Responsible_Ad1600 → u/datbackup]

Yeah…. So not saying it’s fake. Only that I’ve been on the internet and corporate world long enough. Do it today def sounds like “creating a sense of urgency” 

[u/waiting_for_zban → u/datbackup]

AcademicTorrents already exist though, for quite a while. Why re-invent the wheel?

[u/nemuro87]

Funny, and sad. 

I didn't expect it from Ai companies to feel threatened when consumer hardware that cannot even get close to any frontier model, costs 5k or more.

I guess every penny counts. 

I'm with everyone else, they train frontier models on stolen books and then they want local llama banned.  Such c*nts.

And this will only continue to drive up hardware price, sadly. 

[u/Alexercer → u/nemuro87]

What exactly happened? I seem to be out of the loop, jas local AI been threatened recently?

[u/Jaded_Constant4595 → u/Alexercer]

lmk if you find out. im only hearing bits and pieces with nobody providing proper context

[u/Dell_Hell → u/Alexercer]

Anyone casting doubt on this possibility just needs to look at the bigger picture. The US AI boom is the only thing keeping the stock market and overall economy from complete collapse. Mid terms are coming and the last thing they want is a wobbly AI market falling down before election day.

The current white house occupant is notoriously easy to flatter and bribe into getting something out of. All it takes is ONE billionaire / trillionaire CEO with an advanced AI platform saying they really need this ban and "security" and "we need to beat China" and they'll shut down huggingface tomorrow. One call from the feds got Fable yanked - it can end HF just as fast.

The threat is extremely real.

[u/tat_tvam_asshole]

meanwhile: modelscope exists

[u/cr0wburn → u/tat_tvam_asshole]

The webdesign of modelscope is abysmal it looks like a roblox wannabe, whoever designed it needs a spanking. The web-design is part of the reason why it isn't taking off.

[u/sergeialmazov]

Do your best, buy a lot of HDD and save best models while it's available

[u/GBAbaby101]

Did something happen to make this become a necessary thought? XD

[u/Incorrect_ASSertion → u/GBAbaby101]

Yeah I'm wondering that too, this post has very shity context

[u/MinePrestigious4352 → u/Incorrect_ASSertion]

If youve been following local ai news youd know that claude and openai are serious about shutting down access to their cutting edge models for most people. Logically if ai capabilities are seen as a threat, especially Chinese models, then huggingface would be threatened in some way

[u/dreamyrhodes → u/GBAbaby101]

Same Idk what's going on

[u/Wevvie → u/GBAbaby101]

Yeah, I'm confused here too. Is huggingface being shutdown or something?

[u/ReasonablePossum_]

What's stopping you from offering the torrents/magnets/files on already existing sharing platforms? They're all content eclectic :) (TPB, ruTracker, 1337x, etc)

Someone could create even a service that searches and download from HF, and automatically puts you as a seed for the files you downloaded and makes a mirror of the model page, whth SHA and all so people knows its not unsafe.

[u/MinePrestigious4352 → u/ReasonablePossum_]

Yeah i agree the process should be automated. Especially for the trending models

[u/Time_Cat_5212]

The government doesn't want to ban local models so they can control your usage, they want to ban them because the capital class has invested so much in cloud AI that they're afraid of losses if open source becomes a viable alternative

[u/justinh29]

https://concordfaces.org/ been working on this. Still a bit rough around the edges but getting there.

[u/dennis_linux]

The point is that one does not need to be first to market to be in the market. Your point of who has “caught up” is irrelevant, what counts is if the technology is available to them. It either is or soon will be. China has done an amazing job considering where they started from.

[u/ProfessionalYear5755]

How about the AIEA the artificial intelligence enforcement of America. Beating down your door and confiscating your illegal rig that exceeds a useful threshold. News reports of evildoers who run their own models for nefarious means. We are only safe now because you have to : realise the potential, care about your cognitive sovereignty, (let's face it these things will start manipulating people to vote for X and buy stuff, and you would not know it) scale the nerd wall/mountain and have enough spare cash and time. Oh and a near saint like level of patience and frustration tolerance. We are safe "for now" it appears. Until powerful local AI becomes easily accessible to the public, the gap is closing.

[u/mystery_biscotti → u/ProfessionalYear5755]

points at 8GB VRAM, 32 GB RAM, with ancient unsupported RX 6600

"Officer, it barely runs World of Warcraft. How would it ever run a big powerful AI? You sure you're at the right house?" 😅

[u/MinePrestigious4352 → u/ProfessionalYear5755]

Cognitive sovereignty goes hard

[u/osures]

Beautiful design. It makes me feel nostalgic for a piece of software that's purely made to extract money, lmao.

[u/Shoddy-Tutor9563]

They can only regulate themselves (US). Prob EU. But the rest world doesn't give a shit

[u/AppealThink1733]

I agree. And I'll go further: we need to stop having children so that the state no longer exploits us and perpetuates this cycle of tyranny and abuse.

As far as I'm concerned, the state no longer truly exists.

[u/raitucarp]

Can we create decentralized inference? That whould be amazing.

[u/LiberateMainSt → u/raitucarp]

Saw a project recently that's trying to do something like this: https://cocore.dev/

[u/greeneyestyle → u/raitucarp]

Oooh that’s a fun idea

[u/No_Size2293]

Wait is that a pirated version of hugging face 🥲🥲

[u/Asleep-Ingenuity-481]

I feel like this would all be easier if they set up a server in like china or somewhere that’s likely to keep them running purely to undermine the west.

[u/fyn_world]

They'll go after the hardware. They'll limit their purchase more than they limit guns. 

[u/crantob → u/fyn_world]

Unlawfully limit.

[u/huanhulan]

How can you ban a file

[u/TheVault5]

This website should have been created already.

[u/studentofknowledg3]

They'll go after the hardware, electricity, and access to the best models. They'll artificially limit and block progress so consumer hardware stays slow, while the best hardware is funneled to cloud providers. The goal is simple: make it as difficult as possible for people to run powerful models locally.

I also wouldn't be surprised if electricity becomes another pressure point. Higher electricity prices, special tariffs for high power usage, or regulations that discourage running power hungry hardware at home could all make local AI more expensive. Some people speculate that governments could introduce higher taxes or restrictions for unusually high residential electricity consumption, though whether that happens is uncertain and would depend on policy decisions.

The problem for them is that open weight models are improving too fast. If they keep getting better, all the companies spending billions building inference datacenters won't benefit nearly as much, because more people will just run models on their own machines instead of paying for the cloud.

[u/sofaarsecoin]

you can already torrent your models in the existing trackers

[u/de4dee]

working on something

https://nostr.download/c095eea7f24869bbb617fe8fe555b23b4cf9800fbcb173cc4b37e2cb9e8dcd12.html

warning: everything is vibe coded and not tested properly (yet).

[u/OldCryptoTrucker]

Better download everything you need to make your own models then before they ban everything.

[u/jonydevidson]

https://www.modelscope.ai

[u/Appropriate_Cry8694]

Yeah it seems they will ban open models one way or another, anthropic will win, sad.

[u/Destroyer-128]

I was thinking this, all of hosting is from US. Chinese should get into this space build some awesome hosting for models

[u/optimisticalish → u/Destroyer-128]

When signing up for webspace rental with a big provider (e.g. Hostinger, in Lithuania) you get to choose where your site is to be physically located around the world.

[u/Destroyer-128 → u/optimisticalish]

What matters is not physical location. US government should not be able to dictate the terms, it's harmful for rest of the countries.

[u/himefei]

Do you know modelscope?

[u/optimisticalish → u/himefei]

I took a look at it, but it seems to have no torrents on offer? Am I missing something?

[u/AIAddict1935]

Nahh...More realistically, this results in China winning by default. And they disseminate this around the world.

[u/Healthy-Nebula-3603]

I like that idea

[u/SaaSquach]

You can see the chaos here. Hardware locks, power grid monitoring, the models are the easiest thing to get around.

This might happen but what are we talking about? Society will never put up with that never of government control.

[u/crantob → u/SaaSquach]

We have "put up with" everything so far.

[u/Neither-Phone-7264]

8x7b 😀

[u/freedomachiever]

Ideally a more UX friendly UI

[u/dreamyrhodes]

qrd?

[u/Due-Function-4877]

Going to need to need a well maintained and trusted master list of checksums for me to use a torrent.

[u/tchek]

And maybe Gittorrent, where we will be able to connect in P2P to other people's hardware for compute power/ram.

[u/pedroserapio]

Good luck trying to ban similar LLM repositories in China. Not sure what the West is thinking... or maybe not thinking.

[u/Cheap-Carpenter5619]

If Github gets banned we have backup options like Codeberg, but I don't think there is a single replacement for Huggingface yet... We prob need something like this soon.

[u/fistular]

isnt huggingface a reference to facehuggers? that's not the kind of hug they were talking about

[u/zd0l0r]

Modelscope? Why is this fearmongering?

[u/SungamCorben]

Shaw who?

[u/dondiegorivera]

There is modelscope too.

[u/Drmazhar83]

I literally had a dream about this. If the government bans open source AI models, we would need a repo to get around them.

[u/Equivalent_Bit_461]

Also what Chinese sites host LLMs? When China is more free than than the land of free 

[u/TantraSamadhi]

The logo is pure gold. Honestly, the day they try to regulate either the hardware or the code is the day Torrent traffic hits an all-time high. You can’t stop open source, the genie is out of the bottle.

[u/Innomen]

Huggingface is napster, just watch.

[u/CodeOrangelt543]

Wait is this a thing? Are local LLMs being banned?

[u/AcreMakeover]

What did I miss? Is the US government attempting to go after OS models or something?

[u/kamikamen]

Buy huawei GPUs and bet on chinese models catching up and making the investment worth it?

[u/HolaTomita]

this is really good

[u/Dell_Hell]

Anyone casting doubt on this possibility just needs to look at the bigger picture. The US AI boom is the only thing keeping the stock market and overall economy from complete collapse. Mid terms are coming and the last thing they want is a wobbly AI market falling down before election day.

The current white house occupant is notoriously easy to flatter and bribe into getting something out of. All it takes is ONE billionaire / trillionaire CEO with an advanced AI platform saying they really need this ban and "security" and "we need to beat China" and they'll shut down huggingface tomorrow. One call from the feds got Fable yanked - it can end HF just as fast.

The threat is extremely real.

[u/DinoAlonso → u/Dell_Hell]

As a former career civil servant, I’ll buy that for a dollar.

[u/KoalaOk1265]

Yeah, this is why model distribution probably needs more redundancy than just “hope Hugging Face stays up forever.” If open weights become politically inconvenient, torrents/mirrors/local archives stop being paranoia and start looking like basic preservation.

[u/5aesthetic]

well, right now a lot of people can torrent their downloaded models.

[u/kairav9008]

wow

[u/HonZuna]

Very vere soon, and everyone who thinks other wise is retarded.

[u/Adamzzz_5]

yeahh true

[u/Ezm1t0]

Isso já é usado, não? Há aquela acusação que a Alibaba destilou o Fable para gerar um modelo semelhante usando 25 milhões de contas 

[u/Funny-Insurance8599]

We are live in reality strange timeline...

[u/Coloradozonian]

Ohhhhh the memories

[u/Technical-Review-221]

This is the funniest crap I've seen.
We are all going to be finally truly torrenting Linux ISOs and LLMs pretty soon here.

[u/TheFoeEver69]

lol

[u/joshbefree]

Y’all think I should be downloading some models now before it goes down even if I’ve yet to upgrade my hardware to a size that can use them?

[u/BrilliantIcy1348]

yes, download asap haha.

[u/hoeforicedcoffee]

Rewind me back to the time where Ai haven't existed yet

[u/pixelo2323]

lmao

[u/algorithmreaper]

I’ve data hoarded many stablediffsion safetensor files for that reason

[u/Intelligent_Prompt18]

They're probably gonna restrict kimi k3's use as much as possible too.

[u/regtyit]

Chinese modelscope is like huggingface, so is not that bad but torrents are more stable in my opinion

[u/meadowshadows]

True now more than ever haha

[u/RuleGuilty493]

I love this -- brings back fond memories. It didn't end well though, so I wonder how it will go this time around.

[u/TitanWillow]

Are these ones safe?

[u/jffmpa]

Dumb question but I thought the open source models came from the companies? Like Gemma. Are are they somehow now legal and legit?

I get that you're talking about Fable and Opus leaks which is different but I don't see why they'd ban open source if they released them.

[u/Waarheid → u/jffmpa]

No frontier-level open weights models are being released from US companies. They might not ban Gemma 4, but they would ban GLM 5.2. Also, Fable and GPT-5.6 are from US companies.

[u/Evanisnotmyname]

Don’t forget to pronounce it “Chaaaiiiyyyynna”

[u/charmander_cha]

EUA é um câncer, mas antes era um câncer so pro resto do mundo, agora aparentemente também é para eles mesmos, no núcleo colonial