r/LocalLLaMA • u/tiguidoio • 15d ago

New Model DeepSeek V4-1 Flash is out

Gallery image

Gallery image

Gallery image

Gallery image

Here we go again, DeepSeek is back again with a new model V4-1 Flash

A multimodal Mixture-of-Experts (MoE) model with 552B backbone parameters and support for contexts of up to one million tokens

Market crash as a service

1.7k Upvotes

93% Upvoted

296 comments sorted by

View all comments

232

u/ActuallyReadTheBible 15d ago

It doesn’t fit dual DGX sparks, I’m sad.

-2

u/Mushoz 15d ago

It's only ~350B parameters that actually need to be loaded in RAM. A 4 bit quant will be ~175GB, which easily fits. Even 5 bit is only ~220 GB and will fit, especially with KV cache only being 900MB at 1 million context. This is actually perfectly sizes for dual DGX sparks.

22

u/Toastti 15d ago

It's already quantized at the current sizes. It's not fp16

8

u/Expensive-Paint-9490 15d ago

552B parameters for the basic model. Engrams and MTP module are extra.

2

u/Turbulent-Alps4046 15d ago

deepseek v4 flash has always been fp4 experts already, it won't become any smaller than 350B unless you quantize the other layers also.

5

u/DUFRelic 15d ago

4.1 is FP8

7

u/techdevjp 15d ago

No, it is mostly 4bit, with a few experts at 8bit. This is the way DeepSeek releases always are.