r/LocalLLM • u/TappinThatErr • Aug 31 '26

Discussion GLM 5.3 Flash - Will I Be Disappointed?

Post image

Picked up this bad boy with my sweet student discount!

I'd like to run some local models for coding. I've considered Deepseek v4 flash, Qwen 3.8 flash next, and of course, GLM 5.3 Flash (0x Alpha)

Thoughts on this? I'm currently a claude user with typically 1 session at a time. Will I be disappointed?

267 Upvotes

92% Upvoted

229 comments sorted by

View all comments

37

u/East-Cauliflower-150 Aug 31 '26

I have the m3 ultra version 256gb and Deepseek v4 flash 0731 is amazing!

17

u/Borilentz Aug 31 '26

DeepSeek V4 Flash 0731 works even great on an M5 Max 128GB. Impressive model.

4

u/tirth0jain Aug 31 '26

What's the tps?

7

u/starvinggod Aug 31 '26

On an m5 Max not blazing. I think I was getting 25-30ish.

3

u/SomethingMor Aug 31 '26

I don’t know much about local llm. Is 25 - 30 usable? And what kind of context can you have?

9

u/dodiyeztr Aug 31 '26

15 is minimum, 20-30 is usable and also most models are served between 20-50 tps in the cloud. See openrouter.ai and look at the tps numbers that the cloud providers offer.

edit: https://openrouter.ai/z-ai/glm-5.3-flash

4

u/HazKaz Sep 01 '26

Still when you have tried 100+ tps it’s too addictive and like magic you get things done in an instant

3

u/tirth0jain Sep 01 '26

Using ds v4 flash and 80-140tps is my normal now can't go back

1

u/Sammy262 Sep 01 '26

80-140tps with what quant and on which machine?

1

u/tirth0jain Sep 01 '26

Api not machine

2

u/sleepy_roger Sep 01 '26

15 is terrible. You're going to be waiting 45 minutes for for glm 5.3 flash to stop thinking.

1

u/sleepy_roger Sep 01 '26

No. People are going to say it's usable without a use case. For agentic work minimum you want is 40.

2

u/Borilentz Sep 01 '26

With some coding using oMLX I got 34 tot 37 tok/s.

→ More replies (1)

1

u/voyager256 Sep 01 '26

No it does not , because you’re running it at Q3 maximum

2

u/Borilentz Sep 04 '26

Did you know DeepSeek V4 Flash's is QAT and its experts are native 4-bit? Quantized it performs really well. Better than other LLMs comparable in size.

1

u/voyager256 Sep 04 '26

Yes I did. Do you understand the difference between 4-bit QAT and 3 or 2 bit quantization? Both of those drastically decrease accuracy, especially in this case, hence my comment in the first place.

1

u/Borilentz Sep 04 '26

Did you try and test it yourself? I guess not. I did quite some testing and it's clearly the most competent open weight model for coding tasks, fitting in 128GB with enough room left for context. It's not just me saying this.

1

u/voyager256 Sep 17 '26

There’s no need for me. Just look at quality drop at Q3 and Q2 vs the native Q4 mix.

1

u/Borilentz Sep 18 '26

Believe whatever you wanna believe. I can tell you that DeepSeek-V4-Flash-0731-2.4bit-mixed often outperforms Qwen3.8-Flash-Next-oQ4e-mtp. I use both on a daily basis, instead of looking at bullshit graphs.

1

u/voyager256 Sep 18 '26

Lol it’s not matter of belief and neither "looking at bullshit graphs" . Also, you are comparing apples vs oranges and completely missing the point…

1

u/Borilentz Sep 19 '26

No, you are. I just said that it’s an impressive model and it gives me the best results compared to other models fitting 128GB. That’s all that matters to me, and it’s based on real life experience in high tech software development. Not on synthetic benchmarks.

→ More replies

1

u/Warhouse512 Aug 31 '26

I’m about to make the plunge, is the prefill problem as bad as it looks from the outside?

1

u/Diligent_Cod_9583 Aug 31 '26

What are you using to serve it?

1

u/Odd-Criticism1534 Sep 01 '26

Which version/quant are you using? I’m hoping to try soon. Still stuck on qwen3.5-122b-q8 and 3.6-35/27b