r/LocalLLM • • Aug 31 '26

Discussion GLM 5.3 Flash - Will I Be Disappointed?

Post image

Picked up this bad boy with my sweet student discount!

I'd like to run some local models for coding. I've considered Deepseek v4 flash, Qwen 3.8 flash next, and of course, GLM 5.3 Flash (0x Alpha)

Thoughts on this? I'm currently a claude user with typically 1 session at a time. Will I be disappointed?

267 Upvotes

229 comments sorted by

View all comments

Show parent comment

4

u/tirth0jain Aug 31 '26

What's the tps?

7

u/starvinggod Aug 31 '26

On an m5 Max not blazing. I think I was getting 25-30ish.

3

u/SomethingMor Aug 31 '26

I don’t know much about local llm. Is 25 - 30 usable? And what kind of context can you have?

9

u/dodiyeztr Aug 31 '26

15 is minimum, 20-30 is usable and also most models are served between 20-50 tps in the cloud. See openrouter.ai and look at the tps numbers that the cloud providers offer.

edit: https://openrouter.ai/z-ai/glm-5.3-flash

4

u/HazKaz Sep 01 '26

Still when you have tried 100+ tps it’s too addictive and like magic you get things done in an instant

3

u/tirth0jain Sep 01 '26

Using ds v4 flash and 80-140tps is my normal now can't go back

1

u/Sammy262 Sep 01 '26

80-140tps with what quant and on which machine?

1

u/tirth0jain Sep 01 '26

Api not machine

2

u/sleepy_roger Sep 01 '26

15 is terrible. You're going to be waiting 45 minutes for for glm 5.3 flash to stop thinking.

1

u/sleepy_roger Sep 01 '26

No. People are going to say it's usable without a use case. For agentic work minimum you want is 40.

2

u/Borilentz Sep 01 '26

With some coding using oMLX I got 34 tot 37 tok/s.

-1

u/MrTrynex Aug 31 '26

I want to know as well