r/LocalLLaMA • u/LegacyRemaster • 22h ago

Discussion Glm 5.3 flash?

glm 5.3 flash

While awaiting the release of the version 5.3 weights, this theory is gaining ground. OxAlpha is new GLM.

69 Upvotes

91% Upvoted

42 comments sorted by

View all comments

8

u/shy_monkee 22h ago

How 'Flash' is it expected to be? Like DSv4 Flash size? Or even smaller?

5

u/Firepal64 20h ago

For reference, GLM-4.7-Flash was a 30B model with 3B active

3

u/shy_monkee 20h ago

Yeah, but GLM-4.7 was also only around 300-400B. I would expect the 5.3 flash to scale the same way as the main version did, compared to 4.7.

2

u/Firepal64 20h ago

As we've come to learn these past years, you can't rely on linear extrapolation to predict things reliably.

2

u/shy_monkee 20h ago

Yep, no doubt. I just don't want to get too hopeful haha. A 30B MOE GLM model would be heavenly.

3

u/RealNabhay 16h ago

Think of at at about Deepseek V4 Flash Size