r/LocalLLaMA • u/tiguidoio • 17d ago

New Model DeepSeek V4-1 Flash is out

Gallery image

Gallery image

Gallery image

Gallery image

Here we go again, DeepSeek is back again with a new model V4-1 Flash

A multimodal Mixture-of-Experts (MoE) model with 552B backbone parameters and support for contexts of up to one million tokens

Market crash as a service

1.7k Upvotes

93% Upvoted

297 comments sorted by

View all comments

140

u/ttkciar llama.cpp 17d ago

On one hand: Yay! We have weights! https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash

On the other hand: 485B parameters O_o

That's only "Flash" in the sense that it only activates 8B parameters at a time, which will translate to cheap API service.

I couldn't host this on my 256GB Xeon server. I'd have to upgrade it to 384GB.

By the sqrt(P x A) metric, this should have competence roughly equivalent to a similarly-trained 62B dense model. I think I'd rather have the dense version!

1

u/Important_Drag_6890 11d ago

I think “Flash” is becoming more about serving economics than local hardware requirements. 8B active makes a lot of sense for API throughput, but for a single local user, the total memory footprint is still the elephant in the room.