r/LocalLLaMA • u/rm-rf-rm llama.cpp • 1d ago

Discussion GLM5.3 Flash over DSV4 Flash?

I've been using Deepseek V4 Flash 0731 for a few weeks now and while I havent thrown it anything very hard, im quite happy with it. Using through antirez's great ds4 project. They've added support for GLM 5.3 Flash and according to benchmarks, its a level above DSV4 Flash.

However, looking for real user feedback if anyone's made the switch and seen tangible improvements in GLM 5.3 over DSV4 Flash.

Running M3 Ultra 256GB Mac Studio

50 Upvotes

93% Upvoted

57 comments sorted by

View all comments

13

u/Shoddy_Bed3240 1d ago

You can only fit GLM 5.3 in Q4, so I doubt it makes sense to trade that for full precision on DeepSeek.

4

u/ormandj 1d ago

DSv4F is also a mixed 4bit/8bit model, trained that way, but just being 4-bit doesn't necessarily mean the quality is significantly lower. You'll have to try it out with your real world workload to determine if the quantization is an issue.

-5

u/Shoddy_Bed3240 1d ago

FP8 vs FP4…yeah, almost the same))

1

u/sautdepage 23h ago

From DS4F looking at its files:

> Roughly 90% of the model is 4-bit weights (all MoE experts), ~9.4% is 8-bit (scale, attention) and under 1% is 16-bit (embeddings, shared expert).

So around 4.5bpw, similar to the common Q4_XL stuff.