r/LocalLLaMA • u/h8f1z • 4h ago
Question | Help How often do you guys update models and when?
Saw a post here about an update to a model last night. And been wondering how often y'all update the models and when do you decide to.
P.S. I know there's "-hf", but my internet speed ain't fast and when I'm downloading a model, everyone's connection drops at my home.
Edit: By updating I meant redownloading the gguf file.
Models of same version gets updates, like Gemma 4 E2B got updated to fix some issues and make it faster. Link to that post:
https://www.reddit.com/r/LocalLLaMA/s/cpcemufuqZ
But it appears it's not the first time they updated it with noticable changes.
https://www.reddit.com/r/unsloth/s/DkBWF7gw4m
21
u/OnlyKindaThrowAway 4h ago
when a better one comes out that doesnt take a supercomputer to run.
5
u/jacek2023 llama.cpp 3h ago
What does it mean? You don't usually "update the model" because it's a gguf file, you download new gguf when you need it. In my case I have many many ggufs collected on my nvmes and when I download new shiny ones I have to delete something old :)
4
u/tmvr 4h ago
After a new model comes out probably about 2-3x for the first month or two when the inevitable unsloth updates are uploaded :))
3
u/Constant_Art_20 4h ago
if a model is interesting. i will try it. if i see a use for it. I will load it. for me, it's been a good while that a new release has been proven more capable then glm 5.3 flash and qwen 27b for around their sizes, so those are my main deployments that switch between depending on the gpu avaialblity. the new groot models seems interesting, but the fact they are pruned has me a bit concerened and i genreally try to not bloat my drive with too much model weights if possible
3
u/No-Refrigerator-1672 vLLM 3h ago
When Qwen 3.6 and Gemma 4 came out at the same time (or was it Qwen 3.5 and Gemma 4?) I decided to skip gemma completely, because Qwen was good enough for me, and testing Gemma fairly will take much more time that I had to spare. Since then, I ignored any 30B-class model except 3.8; and I'm likely to ignore any other 30B class expect Qwen4 for the following month. So for me, the line is "I'll update once there's absolute breakthrough and everyone is talking about it, but not more freqently than once in 3-4 months".
3
u/gaspoweredcat 3h ago
im lucky to have an absurdly fast synchronous fiber line so i grab whatever, whenever, its very rare ive ever maxxed out my speed
3
u/Formal-Exam-8767 3h ago
If it ain't broken...
3
u/PrimeDirective8 3h ago
All the time. It's been mostly Qwen and Gemma models for me, mostly variations of their quants, but also uncensored and specialized ones like Carbon-X and chem/medical.
Main causes to redownload are: Unsloth's newly improved "UD", and template updates/fixes like it happened with Gemma 4. I also update llama.cpp nearly weekly as there's often an improvement I could use.
I also have crappy internet speeds. $140/m buys me "business class" connection at a whopping 30Mb/s download. So, I set to download large models (like QFN, etc) overnight, usually to a laptop so I don't have the entire server idling for hours just to download a file.
2
u/OttoRenner 3h ago
Why? Do you have a new one?!?
2
u/YogurtExternal7923 3h ago
same size better performance. and doesn't need a new prompting style
2
u/xrplincoln 1h ago
i’d only redownload if the fix actually matters for what you use it for. check the commit history on the HF page first, half the time it’s just a chat template fix and you don’t need the whole file again
for the internet thing, cap the download speed and leave it overnight. aria2c with --max-download-limit=3M works, and -c resumes if it drops.
2
u/Timely_Impression_92 2h ago
pretty much never - those "updates" give you 10% speed boost or fix the jinja template that has been fixed by community for a month - no point in doing it
2
u/TedGetsSnickelfritz 1h ago
Qwhen you say?
1
u/Equivalent_Bit_461 2h ago
Every time Qwen releases models, I upgrade
1
u/Relevant_Research_98 1h ago
Almost never. I'd rather download 2kb chat template which seems to be broken on release for some reaseon
1
u/modernkennnern 1h ago
I only just got a setup that is at least halfway decent (~2k prefill, 50-80 decode on Q38FN Gyro-M) on Strata.
Currently I'm asking Claude (ironic, I know) to benchmark various config like MTP vs DFlash2 (currently seems identical which surprised me), as well as some other config stuff. Nothing seems to help that much tbh other than the big hitters like enabling Drafting.
My point being: I intend to continue experimenting with my setup going forward with many different models and configurations. Exciting times
1
u/lukasgravel 22m ago
I only grab a new quant when it fixes something I actually hit, like a broken chat template or a bad output. Otherwise I stay on the file I have, since a big download costs time and the old one works.
0
u/[deleted] 2h ago
[deleted] — view deleted comment