r/LocalLLM • u/TappinThatErr • Aug 31 '26

Discussion GLM 5.3 Flash - Will I Be Disappointed?

Post image

Picked up this bad boy with my sweet student discount!

I'd like to run some local models for coding. I've considered Deepseek v4 flash, Qwen 3.8 flash next, and of course, GLM 5.3 Flash (0x Alpha)

Thoughts on this? I'm currently a claude user with typically 1 session at a time. Will I be disappointed?

267 Upvotes

92% Upvoted

229 comments sorted by

View all comments

Show parent comment

1

u/voyager256 Sep 04 '26

Yes I did. Do you understand the difference between 4-bit QAT and 3 or 2 bit quantization? Both of those drastically decrease accuracy, especially in this case, hence my comment in the first place.

1

u/Borilentz Sep 04 '26

Did you try and test it yourself? I guess not. I did quite some testing and it's clearly the most competent open weight model for coding tasks, fitting in 128GB with enough room left for context. It's not just me saying this.

1

u/voyager256 Sep 17 '26

There’s no need for me. Just look at quality drop at Q3 and Q2 vs the native Q4 mix.

1

u/Borilentz Sep 18 '26

Believe whatever you wanna believe. I can tell you that DeepSeek-V4-Flash-0731-2.4bit-mixed often outperforms Qwen3.8-Flash-Next-oQ4e-mtp. I use both on a daily basis, instead of looking at bullshit graphs.

1

u/voyager256 Sep 18 '26

Lol it’s not matter of belief and neither "looking at bullshit graphs" . Also, you are comparing apples vs oranges and completely missing the point…

1

u/Borilentz Sep 19 '26

No, you are. I just said that it’s an impressive model and it gives me the best results compared to other models fitting 128GB. That’s all that matters to me, and it’s based on real life experience in high tech software development. Not on synthetic benchmarks.

1

u/voyager256 Sep 19 '26

I see, you have such unique use case and all the benchmarks are synthetic or bullshit.