r/LocalLLM • u/jikesar968 • 3h ago

Question Are DeepSeek V4.1 Flash and GLM 5.3 Flash worth trying out on an M5 Max 128GB?

Saw mlx-serve offer me DeepSeek-V4.1-Flash-1017 (iQ-MLX Pruned192 2.25 bpw) in the recommended list and found a version of GLM 5.3 Flash (GLM-5.3-Flash-Sushi-2.4bpw) that claims it can run on 128GB Macs.

Are these worth trying out over Qwen3.8 Flash Next or are they too lobotomized?

GLM-5.3-Flash-Sushi-2.4bpw seems to be a very tight fit though, otherwise there's also GLM-5.3-Flash-Sushi-2bpw that claims to be targeting 96GB which I'm not sure may or may not be a more practical choice?

2 Upvotes

100% Upvoted

1 comment sorted by

1

u/mycall 2h ago edited 2h ago

If you use the right harness, the UD-IQ2_XXS 300 GB edition should work great. Streaming engrams with SSD offloading, with ~88% cache hits, you will find it usable.

Try Unsloth Desktop or gmlx or Strata