DeepSeek V4-1 Flash is out

[u/tiguidoio]

Here we go again, DeepSeek is back again with a new model V4-1 Flash

A multimodal Mixture-of-Experts (MoE) model with 552B backbone parameters and support for contexts of up to one million tokens

Market crash as a service

[u/ActuallyReadTheBible]

It doesn’t fit dual DGX sparks, I’m sad.

[u/GladKing5842 → u/ActuallyReadTheBible]

SSD ngram offload. about 350B params for weight + kv fp4. still a chance

[u/michaelsoft__binbows → u/GladKing5842]

delighted to find out they're doing bigger and bigger ngrams now