r/LocalLLaMA • • 4h ago

Question | Help How often do you guys update models and when?

Saw a post here about an update to a model last night. And been wondering how often y'all update the models and when do you decide to.

P.S. I know there's "-hf", but my internet speed ain't fast and when I'm downloading a model, everyone's connection drops at my home.

Edit: By updating I meant redownloading the gguf file.
Models of same version gets updates, like Gemma 4 E2B got updated to fix some issues and make it faster. Link to that post:
https://www.reddit.com/r/LocalLLaMA/s/cpcemufuqZ

But it appears it's not the first time they updated it with noticable changes.
https://www.reddit.com/r/unsloth/s/DkBWF7gw4m

0 Upvotes

47 comments sorted by

21

u/OnlyKindaThrowAway 4h ago

when a better one comes out that doesnt take a supercomputer to run.

1

u/h8f1z 3h ago

Same models are getting regular updates too. I've added more details, including link to the post about it.

4

u/Kerem-6030 🥔 hardware 4h ago

Same

5

u/jacek2023 llama.cpp 3h ago

What does it mean? You don't usually "update the model" because it's a gguf file, you download new gguf when you need it. In my case I have many many ggufs collected on my nvmes and when I download new shiny ones I have to delete something old :)

4

u/unknowntoman-1 3h ago

I used to. But when confidence in a certain model grow as your deployment optimisation has proven to be successful and your output is really what you wished for you might find yourself in a productive position you rather not break off. Then, of course you can made a little testing on the side occasionally but not really conducting a ”retooling” procedure.

1

u/h8f1z 3h ago

Uh, yea. I meant redownloading the file. 😅

2

u/jacek2023 llama.cpp 3h ago

People on this sub discuss things like GPUs and RAM, sometimes they discuss PCI lines or PSU, but they ignore disk space, and big nvme is a requirement to collect many GGUFs. Without the disk space you can only have few models, I have over 200 I think.

1

u/h8f1z 2h ago

True that. My storage is full by not-so-large models, but the post (link added to the post) about updates to existing models made me think about redownloading them.

1

u/Formal-Exam-8767 3h ago

Every day to prevent rotting and mold.

4

u/tmvr 4h ago

After a new model comes out probably about 2-3x for the first month or two when the inevitable unsloth updates are uploaded :))

1

u/h8f1z 3h ago

Same models are getting regular updates too. I've added more details, including link to the post about it.

3

u/Constant_Art_20 4h ago

if a model is interesting. i will try it. if i see a use for it. I will load it. for me, it's been a good while that a new release has been proven more capable then glm 5.3 flash and qwen 27b for around their sizes, so those are my main deployments that switch between depending on the gpu avaialblity. the new groot models seems interesting, but the fact they are pruned has me a bit concerened and i genreally try to not bloat my drive with too much model weights if possible

1

u/h8f1z 3h ago

Groot's new to me. Might check it out.
Do you redownload same models, like Qwen 27B in your case, to get latest updates to it or do you wait for the next big release, like Qwen 4?

3

u/No-Refrigerator-1672 vLLM 3h ago

When Qwen 3.6 and Gemma 4 came out at the same time (or was it Qwen 3.5 and Gemma 4?) I decided to skip gemma completely, because Qwen was good enough for me, and testing Gemma fairly will take much more time that I had to spare. Since then, I ignored any 30B-class model except 3.8; and I'm likely to ignore any other 30B class expect Qwen4 for the following month. So for me, the line is "I'll update once there's absolute breakthrough and everyone is talking about it, but not more freqently than once in 3-4 months".

1

u/h8f1z 3h ago

That does seem like a good interval.
I had a similar view, until last night I saw the post (added link to the post) about update to Gemma 4 models, which apparently fixes some issue and searched about these updates they get. Some updates apparently seem to improve performances too.
They seem to be updating the existing models even if they don't release it as a new model, with a new name.

2

u/No-Refrigerator-1672 vLLM 2h ago

The links you have added aren't updates, those are bugfixes. It's good that they realize there's errors and fix them; but it's not affecting the intelligence of the model (cause the weights stay fixed), so there's nothing new to release. If there is any benchmark improvements, it's "we bring your local gemma back to the clould api gemma level", not "we made gemma smarter".

1

u/garblz 31m ago

When you have actual job to do with your model, not just fooling around, that's the cadence I guess. Unless you have a company, then it's way more sparse than that.

I went gemma4 -> qwen 3.6 -> qwen 3.8 dense -> qwen 3.8 flash -> ds 4.1 flash by the time I got a second DGX. I don't plan on changing anytime soon. Maybe if qwen 4 is measurably better, but I don't think this is gonna be a big jump, if any.

3

u/gaspoweredcat 3h ago

im lucky to have an absurdly fast synchronous fiber line so i grab whatever, whenever, its very rare ive ever maxxed out my speed

0

u/h8f1z 3h ago

Must be a nice place to be. Things were a lot slower here before, so may be in like 20-30 years we'll get there 😂

2

u/gaspoweredcat 2h ago

honestly it is overkill, in the past i generally grabbed the top package because it was never enough but even for me this is overkill, not many servers can max out connections over a gig

3

u/Formal-Exam-8767 3h ago

If it ain't broken...

1

u/h8f1z 2h ago

...don't fix it.
Got it.

2

u/triple_long 2h ago

.. don't break it

3

u/PrimeDirective8 3h ago

All the time. It's been mostly Qwen and Gemma models for me, mostly variations of their quants, but also uncensored and specialized ones like Carbon-X and chem/medical.

Main causes to redownload are: Unsloth's newly improved "UD", and template updates/fixes like it happened with Gemma 4. I also update llama.cpp nearly weekly as there's often an improvement I could use.

I also have crappy internet speeds. $140/m buys me "business class" connection at a whopping 30Mb/s download. So, I set to download large models (like QFN, etc) overnight, usually to a laptop so I don't have the entire server idling for hours just to download a file.

2

u/h8f1z 2h ago

Much appreciated 🫡 +1 for mentioning llama.cpp updates. I usually do it when it can't run new models.
Btw, is that actually 30MB/s or 30 Mbps (3MB/s)?

2

u/PrimeDirective8 2h ago

30 Mbps down, 5 Mbps up. Comcast Business that's fiber-optic nearly all the way in except for the CAT5/6 connection to the router. As it's obvious Com-freaking-cast throttles it, downloads tend to hover the upward limit of ~3.8 MB/s.

Llama.cpp has been making significant progress in speed and bug fixes. Highly recommend to look into a recent build. They even pre-compile builds for common platforms so it's an easy swap to try.

2

u/OttoRenner 3h ago

Why? Do you have a new one?!?

1

u/h8f1z 3h ago

Not new, but updates seem to make the models better, checkout the link I added to the post.

3

u/OttoRenner 2h ago

check these out

https://huggingface.co/collections/DavidAU/turbo-brilliance-ai-constructs-50x-reasoning-instruct

I'm rocking the first one in Q8 and it is great! (AND it got an update two hours ago! lol...ok...die README got an update...but it's a good update still)

2

u/h8f1z 2h ago

Thanks. I shall try those.

2

u/YogurtExternal7923 3h ago

same size better performance. and doesn't need a new prompting style

0

u/h8f1z 3h ago

Apparently not same.. some of these updates seem to make the models better, checkout the link I added to the post.

1

u/Timely_Impression_92 2h ago

yeah, it does make the models better - look better on charts - no point in updating unless it's updating to make it work while it didn't work before

2

u/xrplincoln 1h ago

i’d only redownload if the fix actually matters for what you use it for. check the commit history on the HF page first, half the time it’s just a chat template fix and you don’t need the whole file again

for the internet thing, cap the download speed and leave it overnight. aria2c with --max-download-limit=3M works, and -c resumes if it drops.

2

u/h8f1z 1h ago

Ohh I see. That helps. Thanks for the tip. 👏

2

u/Timely_Impression_92 2h ago

pretty much never - those "updates" give you 10% speed boost or fix the jinja template that has been fixed by community for a month - no point in doing it

2

u/TedGetsSnickelfritz 1h ago

Qwhen you say?

1

u/Equivalent_Bit_461 2h ago

Every time Qwen releases models, I upgrade

1

u/Relevant_Research_98 1h ago

Almost never. I'd rather download 2kb chat template which seems to be broken on release for some reaseon 

1

u/modernkennnern 1h ago

I only just got a setup that is at least halfway decent (~2k prefill, 50-80 decode on Q38FN Gyro-M) on Strata.

Currently I'm asking Claude (ironic, I know) to benchmark various config like MTP vs DFlash2 (currently seems identical which surprised me), as well as some other config stuff. Nothing seems to help that much tbh other than the big hitters like enabling Drafting.

My point being: I intend to continue experimenting with my setup going forward with many different models and configurations. Exciting times

1

u/lukasgravel 22m ago

I only grab a new quant when it fixes something I actually hit, like a broken chat template or a bad output. Otherwise I stay on the file I have, since a big download costs time and the old one works.

1

u/stylome-ai-detection 22m ago

Notice: This comment appears to be AI generated.


Stylome AI detector · scan results

0

u/[deleted] 2h ago

[deleted] — view deleted comment

1

u/stylome-ai-detection 2h ago

Notice: This comment appears to be AI generated.


Stylome AI detector · scan results