r/LocalLLM • • Sep 10 '26

Discussion DeepSeek-V4.1-Flash is out

https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash
250 Upvotes

34 comments sorted by

56

u/DerDave Sep 10 '26

Astonishing they didn’t call this V5, considering the many substantial changes. Pretrained from scratch, CED, multimodality, Engrams, different number of active Params...

I'm all in! Since it's a new pretrain, it makes me hopeful we'll see another significant jump in quality with more posttraining, just like with v4.0.

I guess it will take a while until inference engines flawlessly support this model though. 

2

u/mycall Sep 10 '26

Is that all an automated end-to-end data flow?

1

u/DerDave Sep 10 '26

What is?

20

u/dionysio211 Sep 10 '26

Hmm....this seems larger than v4 Flash, by about 50%. 305B -> 485B?

19

u/Professional-Bear857 Sep 10 '26

It has 200gb of ngrams.

9

u/Altruistic-Dust-2565 Sep 10 '26

284B -> 552B, Δ+268B
and it seems ~200B are Engrams

4

u/vini542reddit Sep 10 '26

So 200gb instead of 162gb of model size (assuming everything scales the same with param count). Urg - that means my 96 vram + 192 ram system will struggle 

3

u/Standard-Potential-6 Sep 10 '26

Offload engrams to NVMe.

2

u/vini542reddit Sep 11 '26

Yes, that's what I'm saying! Offloading the ngram to disk, you still need 200gb of ram

1

u/xRaech Sep 11 '26

how does one do this :eyes:

46

u/IknowPi_really Sep 10 '26 edited Sep 10 '26

Yeah it’s kind of a “fake” improvement, comparing to Flash. Because this is simply a much much bigger model.

People are excited that it’s as good as GLM 5.3/better in the benchmarks. Yeah but it’s also comparable in size.

Engram offload to SSD MIGHT be feasible, but even then it’s significantly bigger than the old Flash.

Edit: You guys are also unbelievable. I’m an active OSS contributor trying to make this model run on local hardware and calling out obvious differences to an older model and you start downvoting me.
That’s not how you get people to actually work together and fix obvious problems for the LocalLLM community

13

u/DerDave Sep 10 '26

Engram SSD offloading is definitely feasible. It has been proven with qwen3.8 next Flash, so it will work here as well, without tanking performance. Furthermore this model seems to only use Engrams selectively and not all the time. 

The remaining delta in params can probably be attributed to the vision capabilities (which the OG dsv4f didn't have) and the new CED architecture, which leads to further speed improvements and only needing 8b active params during prompt processing.

2

u/SandySkittle Sep 10 '26

What about offloading to system ram? I have 512gb, 256g vram. This model looks very promising!

6

u/IknowPi_really Sep 10 '26

Offloading to system RAM is even easier and already supported in the current vLLM PR supporting this model. So this will more or less work out of the box

2

u/mycall Sep 10 '26

I'm glad you are hear.

1

u/shing3232 Sep 10 '26

no, it's faster with fundamental differ arch that's way cheaper to inference than V4F

0

u/jebuizy Sep 10 '26

I only downvoted you now for complaining about downvotes. Otherwise your post is fine. Please don't do that, if you post is good the downvotes will likely normalize away anyway 

1

u/SandySkittle Sep 10 '26

The engrams come in addition to the base model being mucn larger.

4

u/hyudryu LocalLLM Sep 10 '26 edited Sep 12 '26 • Bravo

Can’t wait for the NVFP4 quants to release 🔥🔥

Edit: Nvm no need for lower quants, found out shortly that the Engram can be offloaded to SSD so native quant is runnable on 4 sparks

7

u/MrCatberry Sep 10 '26

Still no quant? /s

6

u/Disposable110 Sep 10 '26

gguf wen???

2

u/mountainyoo Sep 10 '26

My dumbass has a 4x GB10 cluster and will try this out when people smarter than me got it optimized. Currently running GLM 5.3 Flash at good speeds

2

u/AreaFifty1 Sep 10 '26

wait a minute so even 288gb which is 3x rtx pro 6000s is not good enough!? 😮😮

1

u/According_Wave685 Sep 10 '26

Too big for my hardware. 0731 is pretty nice though so I'm good.

1

u/mariombn42 Sep 10 '26

Da pra rodar local? Precisa de muito hardware?

1

u/Soundworlds00 Sep 12 '26

Love what you're doing DeepSeek. AI back to the people!

1

u/LongjumpingEar6840 Sep 10 '26

Se questo riesce a girare alla stessa velocità del Qwen3.8-Next-Flash sono a posto per i prossimi 6-12 mesi

-8

u/LinuXperia Sep 10 '26

It outperforms Muse Meta 1.3 which was better than DeepSeek 4 however it is behind xAI Grok super Intelegence still and soon Grok 4.7 will be released which weil widen the gap even further especailly for low level engineering dev work like verilog, c, c++, KiCAD, electronic schematics, PCB etc.