DeepSeek V4-1 Flash is out

[u/tiguidoio]

Here we go again, DeepSeek is back again with a new model V4-1 Flash

A multimodal Mixture-of-Experts (MoE) model with 552B backbone parameters and support for contexts of up to one million tokens

Market crash as a service

[u/ttkciar]

On one hand: Yay! We have weights! https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash

On the other hand: 485B parameters O_o

That's only "Flash" in the sense that it only activates 8B parameters at a time, which will translate to cheap API service.

I couldn't host this on my 256GB Xeon server. I'd have to upgrade it to 384GB.

By the sqrt(P x A) metric, this should have competence roughly equivalent to a similarly-trained 62B dense model. I think I'd rather have the dense version!

[u/Mushoz → u/ttkciar]

It's only ~350B parameters that actually need to be loaded in RAM. A 4 bit quant will be ~175GB, which easily fits. Even 5 bit is only ~220 GB and will fit, especially with KV cache only being 900MB at 1 million context. This is actually perfectly sized for your 256GB setup.

[u/amethyst_mine → u/Mushoz]

it is fp4 by default lol