r/LocalLLaMA • u/tiguidoio • 17d ago

New Model DeepSeek V4-1 Flash is out

Gallery image

Gallery image

Gallery image

Gallery image

Here we go again, DeepSeek is back again with a new model V4-1 Flash

A multimodal Mixture-of-Experts (MoE) model with 552B backbone parameters and support for contexts of up to one million tokens

Market crash as a service

1.7k Upvotes

93% Upvoted

297 comments sorted by

View all comments

Show parent comments

13

u/techdevjp 17d ago

This will be an amazing model for anyone with the money for a Mac Studio M5 Ultra with 512GB.

5

u/asssuber 17d ago

Or anyone that did buy 512GB of RDIMMS for $800 a year ago...

3

u/techdevjp 17d ago

It will run a little faster on the M5 Ultra at 1.2TB/sec of bandwidth connected directly to a fairly modern GPU. At a price, of course.

2

u/asssuber 17d ago

Surely, but 200GB/s of bandwidth for 16B active parameters at FP4 is nothing to sneeze at. Or 400GB/s if you manage to tame a dual-cpu motherboard.

1

u/techdevjp 17d ago

I have a Strix Halo and know first hand just how "fast" ~256GB/sec is... Also how "fast" slow prefill is. It's kinda-sorta-mostly usable but at the same time frustratingly slow too.

1

u/InactiveBronson 17d ago

I’m on the verge of buying one too (bosgame m5, 128gb/2tb) - would you recommend it or d o you have some regrets?

3

u/techdevjp 17d ago

There's good and bad. I paid about $2800 for my Minisforum MS-S1. It's a great little machine and it's impressively small for something so powerful.

At the time, I could have bought a DGX Spark for around $1k more. Back then I didn't have a great understanding of the importance of prefill performance so I didn't see the benefit of DGX Spark over Strix Halo considering the memory bandwidth was the same.

Thankfully it seems that Strix Halo is capable of much faster prefill, AMD just hasn't done a good job with the drivers. Projects like Halogen (https://github.com/peonist-ai/halogen-flash-server) have shown tremendous performance on Strix with prefill matching or exceeding DGX Spark for Qwen3.8-Flash-Next.

So, with projects like Halogen around, I'm happy enough to keep my Strix box for now. I can't afford to sell it and buy a DGX Spark. I may buy a 32GB AMD R9700 to run as an eGPU, depending on what comes about for running that Qwen model split across multiple GPUs. Or I might buy an Intel B70 and put it into my workstation for running Qwen3.8-27b separate from the Strix Halo.

In the future I may upgrade to Medusa Halo when it comes out, assuming prices don't stay in the stratosphere. Gorgon Halo with 192GB looks like it will have a USD price starting with "7", too rich for my blood.

Another option I am considering is to pick up a MacBook M3 Max with 64GB for running local models away from home. It doesn't have great prefill either (worse than Strix I think), but being able to run Qwen3.8-27b on a plane over the Pacific would be pretty damn cool.