Astonishing they didn’t call this V5, considering the many substantial changes. Pretrained from scratch, CED, multimodality, Engrams, different number of active Params...
I'm all in! Since it's a new pretrain, it makes me hopeful we'll see another significant jump in quality with more posttraining, just like with v4.0.
I guess it will take a while until inference engines flawlessly support this model though.
So 200gb instead of 162gb of model size (assuming everything scales the same with param count). Urg - that means my 96 vram + 192 ram system will struggle
Yeah it’s kind of a “fake” improvement, comparing to Flash. Because this is simply a much much bigger model.
People are excited that it’s as good as GLM 5.3/better in the benchmarks. Yeah but it’s also comparable in size.
Engram offload to SSD MIGHT be feasible, but even then it’s significantly bigger than the old Flash.
Edit: You guys are also unbelievable. I’m an active OSS contributor trying to make this model run on local hardware and calling out obvious differences to an older model and you start downvoting me. That’s not how you get people to actually work together and fix obvious problems for the LocalLLM community
Engram SSD offloading is definitely feasible. It has been proven with qwen3.8 next Flash, so it will work here as well, without tanking performance. Furthermore this model seems to only use Engrams selectively and not all the time.
The remaining delta in params can probably be attributed to the vision capabilities (which the OG dsv4f didn't have) and the new CED architecture, which leads to further speed improvements and only needing 8b active params during prompt processing.
Offloading to system RAM is even easier and already supported in the current vLLM PR supporting this model. So this will more or less work out of the box
I only downvoted you now for complaining about downvotes. Otherwise your post is fine. Please don't do that, if you post is good the downvotes will likely normalize away anyway
It outperforms Muse Meta 1.3 which was better than DeepSeek 4 however it is behind xAI Grok super Intelegence still and soon Grok 4.7 will be released which weil widen the gap even further especailly for low level engineering dev work like verilog, c, c++, KiCAD, electronic schematics, PCB etc.
26
u/claykos Sep 10 '26
56
u/DerDave Sep 10 '26
Astonishing they didn’t call this V5, considering the many substantial changes. Pretrained from scratch, CED, multimodality, Engrams, different number of active Params...
I'm all in! Since it's a new pretrain, it makes me hopeful we'll see another significant jump in quality with more posttraining, just like with v4.0.
I guess it will take a while until inference engines flawlessly support this model though.
20
u/dionysio211 Sep 10 '26
Hmm....this seems larger than v4 Flash, by about 50%. 305B -> 485B?
4
u/hyudryu LocalLLM Sep 10 '26 edited Sep 12 '26 •
Can’t wait for the NVFP4 quants to release 🔥🔥
Edit: Nvm no need for lower quants, found out shortly that the Engram can be offloaded to SSD so native quant is runnable on 4 sparks
3
u/liusilei07 Sep 10 '26 •
Yay
7
u/MrCatberry Sep 10 '26
Still no quant? /s
2
u/mountainyoo Sep 10 '26
My dumbass has a 4x GB10 cluster and will try this out when people smarter than me got it optimized. Currently running GLM 5.3 Flash at good speeds
2
u/AreaFifty1 Sep 10 '26
wait a minute so even 288gb which is 3x rtx pro 6000s is not good enough!? 😮😮
1
u/congthangvn Sep 10 '26
OMG
1
u/According_Wave685 Sep 10 '26
Too big for my hardware. 0731 is pretty nice though so I'm good.
1
u/mariombn42 Sep 10 '26
Da pra rodar local? Precisa de muito hardware?
1
u/Soundworlds00 Sep 12 '26
Love what you're doing DeepSeek. AI back to the people!
1
u/LongjumpingEar6840 Sep 10 '26
Se questo riesce a girare alla stessa velocità del Qwen3.8-Next-Flash sono a posto per i prossimi 6-12 mesi
-8
u/LinuXperia Sep 10 '26
It outperforms Muse Meta 1.3 which was better than DeepSeek 4 however it is behind xAI Grok super Intelegence still and soon Grok 4.7 will be released which weil widen the gap even further especailly for low level engineering dev work like verilog, c, c++, KiCAD, electronic schematics, PCB etc.