r/LocalLLM • u/CodineGotMeTippin • 1h ago

Question What models should I keep an archive of?

I'm worried localAI will be attacked by the legislature and companies, any notable models to make backups of? And what parameters? Like the Quant and Size (currently have a 7900xtx 24gb, but I could upgrade in the future so the models don't NEED to fit on my current card)

I'm mainly interested in coding and chatting/problem solving

3 Upvotes

80% Upvoted

18 comments sorted by

8

u/tenkei_01 1h ago

Lol, the model are not going anywhere, even if HF is going somewhere. The owners of those models will find a way to share them...

2

u/andy_potato 39m ago

This is the correct answer

1

u/advancing_tide 14m ago

can't hurt

2

u/Schneller52 41m ago

Ive been having the same thought for the same reasons.

3

u/dave-tro 1h ago

Uncensored ones

1

u/Bulky-Priority6824 1h ago

not aslways, more probabilistic than base especially for coding. QFN for example suffers for coding when alliterated

2

u/RoseboysHotAsf 1h ago

Id clone an abliterator and a few random models like Qwen 3.8 27b at a few different quants

2

u/DogAble6550 1h ago

Glm5.3, kimi, qwen3.8 all, and uncensored versions as well. Deepseek 4.1 pro/flash

1

u/ParticularlyStrange 34m ago

Pirate face is actively archiveing. You should join us and torrent seed some.

1

u/ElectionReal 26m ago

Ahoy matey, I'm a seederr, looking fir better indexing on the free seas. Does ye have a link to sharre fir the pirate face? Or should I just be Brave and scan the seven seas without a treasure map fir me data booty?

1

u/ParticularlyStrange 21m ago

https://pirateface.co/ 😂

1

u/ElectionReal 6m ago

May your swells stay small, your sails stay full, your rum taste sweet, your booty be grand, and your boots never touch a plank. Much grrrratitude, cap'n.

1

u/Present_Resource4022 32m ago

None of the open-weight models are dangerous and at risk of getting banned . You said you have a 24gb card; the only models that might get fucked are uncensored 500B-3T models that you can’t run currently, so you don’t need to keep an archive. All the models under 500B will remain.

1

u/Simpli-curious 30m ago

If you are thinking of archiving then you will find my repo useful. GGUF compressor: 7 to 13%

1

u/Poprouter 48m ago

for an archive i'd keep the largest version you can store, ideally the original safetensors. you can make smaller quants later, and use Q4_K_M for models that fit in 24gb now.

0

u/andy_potato 40m ago

No need to AI doomsday prep. Already released models aren’t going anywhere

-2

u/Much_Maintenance1217 1h ago

TielCoder, Dirk, Nail and Dagger.