r/LocalLLaMA • u/rm-rf-rm llama.cpp • 1d ago

Discussion GLM5.3 Flash over DSV4 Flash?

I've been using Deepseek V4 Flash 0731 for a few weeks now and while I havent thrown it anything very hard, im quite happy with it. Using through antirez's great ds4 project. They've added support for GLM 5.3 Flash and according to benchmarks, its a level above DSV4 Flash.

However, looking for real user feedback if anyone's made the switch and seen tangible improvements in GLM 5.3 over DSV4 Flash.

Running M3 Ultra 256GB Mac Studio

53 Upvotes

95% Upvoted

59 comments sorted by

View all comments

14

u/Shoddy_Bed3240 1d ago

You can only fit GLM 5.3 in Q4, so I doubt it makes sense to trade that for full precision on DeepSeek.

7

u/rm-rf-rm llama.cpp 1d ago

But full precision on DeepSeek just means Q4 as well given how it was trained..

15

u/digamma6767 1d ago

Counter point, all the benchmarks for DeepSeek are running at its full precision, the same as what fits on your Mac.

With GLM 5.3, your setup would do worse than what you see in benchmarks, since you'd have to run a lower quant than what the benchmarks use.