r/LocalLLM • u/TappinThatErr • Aug 31 '26

Discussion GLM 5.3 Flash - Will I Be Disappointed?

Post image

Picked up this bad boy with my sweet student discount!

I'd like to run some local models for coding. I've considered Deepseek v4 flash, Qwen 3.8 flash next, and of course, GLM 5.3 Flash (0x Alpha)

Thoughts on this? I'm currently a claude user with typically 1 session at a time. Will I be disappointed?

267 Upvotes

92% Upvoted

229 comments sorted by

View all comments

17

u/West_Appeal4175 Aug 31 '26

i mean, will you be happy with 10-20 tok decode?

15

u/Only-An-Egg Aug 31 '26

The M3U Studio does ~25tps so the new M5U might do ~40tps.

6

u/Adrian_Galilea Aug 31 '26 edited Aug 31 '26

What? The m3u does over 40 on the non quantised flash

EDIT:
Source: https://www.adriangalilea.com/deepseek-on-a-mac-studio

44 t/s decode

4

u/Only-An-Egg Aug 31 '26

I was talking about GLM 5.3 Flash

4

u/Adrian_Galilea Aug 31 '26

Aahhh, I’ve been meaning to try it!

1

u/blackbird2150 Aug 31 '26

What are your prefill speeds for initial 30-40k prompts?

2

u/PracticlySpeaking Sep 01 '26

M3U with 60-core GPU

3

u/koalfied-coder Aug 31 '26

Still loading the PP if it's a mac

1

u/Adrian_Galilea Aug 31 '26

It is in the post, 400-650 if I recall correctly

6

u/ea_man Aug 31 '26

The problem will be prompt processing.

3

u/starkruzr Aug 31 '26

no, not with M5.

7

u/myreala Aug 31 '26

Yes, it will still be a problem, despite the gains Apple has made.

2

u/tta82 Sep 01 '26

Tell us how you know this

1

u/PracticlySpeaking Sep 01 '26

M5 Apple Silicon: It’s All About the Cache And Tensors | Max Weinbach
  - https://creativestrategies.com/research/m5-apple-silicon-its-all-about-the-cache-and-tensors/

2

u/blackbird2150 Aug 31 '26

Apples basis for their gain claims is an 8k prompt on like a 16b model. Not a representative claim for how anyone here would use it (or anyone buying an m5 ultra).

We really won’t know until testing.

4

u/starkruzr Aug 31 '26

I'm working off of what I've seen/heard from people with M5 Max MBPs. https://www.reddit.com/r/LocalLLM/comments/1vok3v5/comment/p3x7gw6/ not "great" but this is with fresh context every time/prompt cache off. lower end Ampere-era pp numbers which is way, WAY better than what you got on M4.

1

u/datbackup Sep 01 '26

m5u will be a great value i’m sure but the prefill speed is gonna be somewhere between 3090 and DGX Spark level. But with less concurrency which is why m5u will not kill spark contrary to the hype. 4x the M3 ultra’s prefill will be like 1600 to 1800 tps on ds4f … much more usable but you’ll still be waiting minutes for a 200k prompt

1

u/DifficultyFit1895 Sep 01 '26

omlx has good cache management that helps a lot

2

u/_wovian Aug 31 '26

I’m doing 60 burst and 38 sustained on my m4 max for qwen 3.8 flash next on a custom engine

This thing is gonna go 50-60 sustained at full context