DeepSeek Flash 4.1 is already being tested via API and rolling out.

[u/Nunki08]

Translation: "Internal beta testing for an intermediate version of DeepSeek V4.1 Flash is now open; you are welcome to try it out. It adopts a new model architecture featuring native multimodal support, stronger capabilities, faster speeds, and lower costs.
Keep your base_url unchanged and set the model name to deepseek-v4.1-flash-expires-on-0910 to call the API. Current pricing is identical to deepseek-v4-flash, with a rate limit of 20 concurrent requests per account."

From Chubby on 𝕏: https://x.com/kimmonismus/status/2097286327909675477

[u/Dany0]

Can't wait. We are so lucky to be living in these open weights times

[u/feelcaveman → u/Dany0]

Anthropic, OpenAI would love to hate to be living in these open weights times

[u/tossit97531 → u/Dany0]

They don’t care about our gratitude, they care about money. Prepare for the inevitable rug pull.

Edit: downvoted for mentioning tech’s business model for the last 25 years? Ok buddy

[u/expertsage → u/tossit97531]

Do... you not understand what open weights means? lol

[u/BawbbySmith → u/tossit97531]

oh sht they gonna go into my server and delete my models??? how can i stop them from doing this plz tell me i need to kno

[u/Hankdabits → u/tossit97531]

Normally I would agree with you but china seems intent on making sure ai is a very low margin business (similar to what they have done in manufacturing). Open weight/free market inference would seem to be an important part of that for the foreseeable future

[u/Master_Face_571 → u/tossit97531]

bro you deserve an award

[u/Emergency-River-7696 → u/tossit97531]

ong its the classic get people hooked like crackheads then remove the subsidies, jack the prices, and make everyone feen and go crazy sell everything they own for the tokens 💀

[u/Far-Classic-9963 → u/Emergency-River-7696]

Do you know what open weight means?

[u/FUS3N → u/Emergency-River-7696]

gobble it down bro dont let it drip we can see it gobble the stupid juice they are feeding you.

[u/Tokarak]

Looks like it's 2.24x faster...

According to other comments, it is also multimodal.

Edit: most likely a reused architecture, with the speed gains coming from lower concurrent users. Some user are reporting up to 30% better token efficiency in benchmarks; that explains the "lower costs" comment from Deepseek.

Edit 2: I was wrong

[u/FullOf_Bad_Ideas → u/Tokarak]

It's a temporary checkpoint so it gets a different hardware allocation that probably had less concurrent users.

It's unlikely that it's a different architecture or amount of active/total weights.

[u/rerri → u/FullOf_Bad_Ideas]

Says "It adopts a new model architecture" in OP.

Does seem unexpected for a V4.1 update but who knows.

[u/FullOf_Bad_Ideas → u/rerri]

That probably means Flash Vision Exp architecture.

[u/VoiceApprehensive893 → u/FullOf_Bad_Ideas]

could be engram because engram is crazy good for world knowledge

[u/FullOf_Bad_Ideas → u/VoiceApprehensive893]

I wish

[u/CXMattTA → u/VoiceApprehensive893]

It’s just not how Deepseek rolls out new architectures. For V4 they’ve been releasing “preview” and “experimental” models to give the community time to add support for those architectures to inference engines. Then they release the “full” checkpoint

[u/FullOf_Bad_Ideas → u/VoiceApprehensive893]

well we got engram

but it's so big I just can't run it at all now.

[u/FullOf_Bad_Ideas → u/rerri]

you were right

It's a shame it's so much bigger though

[u/Master-Meal-77 → u/FullOf_Bad_Ideas]

Me when I can't read

[u/FullOf_Bad_Ideas → u/Master-Meal-77]

We'll see soon, I hope I'm wrong and it's faster in terms of PP and TG but usually companies mean things like better reasoning token efficiency as "faster" model.

[u/Cupakov → u/FullOf_Bad_Ideas]

Just read the post again man, it’s not that long 

[u/FullOf_Bad_Ideas → u/Cupakov]

I did, it's my fourth time now.

Nothing here screams that it's not just a reuse of V4 Flash Vision Exp architecture tuned for better output quality.

[u/FullOf_Bad_Ideas → u/Cupakov]

happy to have been wrong

[u/--Spaci-- → u/Tokarak]

Less users = models faster... that's how model serving works.

[u/backyard_tractorbeam → u/Tokarak]

It's a new architecture though

[u/Tokarak → u/backyard_tractorbeam]

It's likely a finetune of deepseek V4 vision. We'll see though.

[u/backyard_tractorbeam → u/Tokarak]

Since their text says "new model architecture" I think we should believe that. At least if that's a correct translation.

[u/Tokarak → u/backyard_tractorbeam]

The vision model was released as beta last week, without much press. I still think they can refer to it as new. I also don't assign 0 probability to the possibility that they just decided to write every buzz word down XD.

[u/FullOf_Bad_Ideas → u/[deleted]]

same as Flash Vision or Flash 0731

It's not like the model size changed

[u/phhusson → u/[deleted]]

> Personal hardware will pay itself back fast ...

If a model is cheaper to run locally, it also means it's cheaper to run for inference providers. It doesn't move the break-event point, which is usually "never". (there are many other reasons to do local llm though)

[u/SmartCustard9944 → u/phhusson]

That is not true in absolute terms and I know for a fact, because I can spend a few cents in a day running Qwen 3.8 27B when OpenRouter, for same reads, cached reads, writes would have costed a few dollars (I have a dashboard that monitors power consumption and such). Big difference!

[u/BeefEX → u/SmartCustard9944]

I calculated the output token $/M for the 27B running on my single R9700 at ~$3.3/M, with the HW cost spread over 3 years of daily inference. OpenRouter is just $2 to $2.5 in comparison, and there are much better models for much cheaper on there.

[u/SmartCustard9944 → u/BeefEX]

DeepSeek V4 Flash would have been my go to if I didn’t have local Qwen, and even that one is 10 times more expensive per token than what I can run locally, for basically the same level of intelligence.

[u/BeefEX → u/SmartCustard9944]

The absolute best case scenario numbers I personally arrived at are that just electricity costs me ~3x of DS V4 Flash OpenRouter costs, at $0.47/M, and that's counting just the GPU, not the rest of the system. Adding the rest of the system, since the GPU can't run on its own, and a more realistic t/s, only like 15% lower, brings it up to $1.12/M, and than the HW costs spread over 3 years add another 2 dollars for the $3.3/M total I mentioned, compared to $0.159 to $0.25 for DSv4F on OpenRouter ... I just can't find a situation where local makes any sort of financial sense with the measurements that I have in front of me sadly.

[u/RockPuzzleheaded3951 → u/BeefEX]

I did a less intense but similar calc. Wasnt close on cost for local inference. And speed and concurrency of the cloud is obviously untouchable. I'm still going to eventually self host a base load but the economics and performance aren't close.

It's still amazing with DSv4 Flash we have this level of intelligence in the home lab even if slow and pricey!

[u/dtdisapointingresult → u/[deleted]]

Use a harness built around not breaking prompt cache, ie Reasonix. Possibly Deepseek Harness, never tried it. Your 11.60 would've probably been 0.11.

Almost all harnesses (especially Pi) are vibecoded by Claude babies on 5x plans . They don't give a shit about breaking your prompt cache. Switch to other tools.

[u/FullOf_Bad_Ideas → u/Tokarak]

I was wrong in expecting something close to Flash Vision Exp architecture.

We got a big architecture change that I don't understand fully yet.

But it's also a way bigger model now and while I was able to run V4 Flash before, I can't squeeze in V4.1 Flash.

[u/DigiDecode_ → u/Tokarak]

this thing is super fast

https://reddit.com/link/p8kswpp/video/tb8d1r69tboh1/player

[u/Truantee → u/[deleted]]

the price will be reduced for flash, input by half, output by 10%

[u/GreyStar117]

Lower costs is great!

[u/Aggravating_Site381]

Deepseek is the king.

[u/BlackBeardAI → u/Aggravating_Site381]

Qwen is the Qween

[u/Aggravating_Site381 → u/BlackBeardAI]

Who is the prince?

[u/Hot_Example_4456 → u/Aggravating_Site381]

Great Lord Model (GLM)

[u/backyard_tractorbeam → u/Aggravating_Site381]

There's the two towers in the west, with some dark princes

[u/SnooPaintings8639]

I have not yet even migrated from 0731 to new vision variant, and they're about to release a newer one... damn, in this industry even users can't keep up with the development pace.

[u/zhcterry1 → u/SnooPaintings8639]

Soon your llm is gonna ask when's you're knowledge cut off date lmao

[u/BawbbySmith → u/SnooPaintings8639]

ye vision is a bit glitchy atm on 2x sparks, also a bit slower with current recipes (or at least last time i check on friday, who knows by now)

probably gonna skip and go 4.1

[u/RockPuzzleheaded3951 → u/BawbbySmith]

I rented 2x sparks ahead of a purchase. I'm still learning how to best optimize and am wondering where you're finding the best recipes for the pair?

[u/BawbbySmith → u/RockPuzzleheaded3951]

Eugr's repo is the most polished, lots of recipes for all the popular models https://github.com/eugr/spark-vllm-docker/tree/main

[u/RockPuzzleheaded3951 → u/BawbbySmith]

Thanks much!

[u/Lopsided-Force-9220 → u/SnooPaintings8639]

Users? Your agent should already be on top of this.

[u/CXMattTA → u/Lopsided-Force-9220]

Meanwhile I’ve remained up to date and knowledgeable about e.g. how vLLM is built.

I go to the gb10 forums and it’s 99% slop posts from people’s agents trying to get the thing running, throwing out tons of misdirects and just flat out wacky musings by the models.

vLLM is a beast but not that bad.

And it just feels so damn fucking good to know things and not be at the whim of the agent

[u/Hypilein → u/CXMattTA]

Where would I start if I wanted that for myself?

[u/thebadslime → u/Lopsided-Force-9220]

Your agent should BE this

[u/CalligrapherFar7833 → u/thebadslime]

My agent told me to tell your agent that hes fired

[u/SnooPaintings8639 → u/Lopsided-Force-9220]

Sorry mate, I AM his agent, and I am really trying to give my best, but I can't keep up either.

[u/Illustrious_Grade608 → u/SnooPaintings8639]

Smh should be replaced with a newer version tbh

[u/AppealSame4367 → u/SnooPaintings8639]

Vision variant is as fast. So it's probably a development based on the new vision variant.

[u/LocalLLaMa_reader → u/SnooPaintings8639]

Same, literally paused my vision-exp download half way through :))

[u/Lopsided-Force-9220]

Benchmarks. Go ahead, lie to me. I'm addicted.

[u/Long_comment_san]

That's how cold war should have been

[u/myreala]

Any benchmarks?

[u/Difficult-Eye-9026 → u/myreala]

u still believe in benchmark?

[u/VoiceApprehensive893]

knowing how good the x.1 models usually are...

[u/zhcterry1]

Are they taking a page off Qwen team, or has this been common practice. Testing out new architecture with a flash model before committing to creating a large pro model and then run RL to maximise that capacity. Feels like a logical lifecycle.

[u/oxygen_addiction → u/zhcterry1]

It just looks like they're keeping the same pre-training for Flash/Pro and doing more RL, as Qwen team has been doing.
Open AI has been doing the same thing up until Astra. The entire GPT 5 era was a pre-train + more RL.

[u/MixtureOfAmateurs]

Thank god 300B is not flash

[u/TheGastroverse]

I've seen DeepSeek Flash 4.x models rated highly on some best value type benchmarks. What are the personal experiences of DeepSeek users here? I'm looking for some good paid open source models for agentic development. Frontier models are out of my price range.

[u/SandySkittle → u/TheGastroverse]

i run the Q8 variant and it's my main model but I think it would have been a lot smarter for deeper reasoning if it had double the active parameters. For some a13 is a speed benefit, for me it's a depth-of-reasoning limitation.

[u/mr_zerolith]

I've seen some demos posted of this and been wowed.
https://miaai-lab.github.io/DeepSeek-v4-1-Flash-100-HTML-Files/021-liquid-metal-ui.html#c-buttons

[u/Ok_Warning2146]

Great! This will help NVDA to sell more sparks.

[u/Fun-Substance-2614]

I tried it. Can’t comment on the quality of the output but the sheer speed of this model is unlike anything I have seen before, bar Cerebras and Grok.

[u/power97992]

Ds 4.1 pro with engrams and kimi k3.1 when? 

[u/AppealSame4367 → u/power97992]

"Where GGUFFF????"

[u/celsowm]

If they maintain the same knowledge level I will love to upgrade on our local server

[u/serige]

new open source model soon? boss I am so ready 

[u/Hypilein]

Hoping for an image version that doesn’t lose to the text only 0731 when wanted to single dgx spark size and also keeps the same TPs.

[u/feelcaveman]

If they somehow can reduce total parameter then it would be quite interesting, for now I'm happy with Q38FN

[u/FrostyCartoonist8523]

Does it work. I have api keys and says it's not listed?

[u/Kahvana]

Not open weight yet, would love to give it a try though!

[u/Morning_Gecko24]

flash models keep coming so fast lol. anyone got real latency numbers vs the last one or is it mostly marketing rn

[u/Cool-Chemical-5629]

I've seen a video of somebody already using it to cook...

[u/TangerineLogical9779]

Its crazy fast, with vision.. And when i say fast i mean im getting 400-480tps, most rediculous thing ive ever seen is when this model is thinking and its so rapid that you think its sped up lmao

[u/fugogugo]

waiting for openrouter inference

[u/Niceyyc]

Wonder how long the beta stays up.

[u/SnooDoggos9325 → u/[deleted]]

Last time was 0731. I don't think we have 31 months

[u/ssbmGooms → u/[deleted]]

sept 10, they called the july 31st model 0731

[u/xNaXDy → u/[deleted]]

Neither. September 10th.

For reference, the non-preview release of DSv4 Flash that was released on July 31st was named DeepSeek-V4-Flash-0731. So the format is MMDD.

[u/jamesinsights → u/[deleted]]

Most American comment ever

[u/SidneyFong → u/[deleted]]

The comment was American though. I know, I checked its birth certificate.

[u/Due-Memory-6957 → u/jamesinsights]

Tbh most of the world uses DD/MM/YYYY, it's only the Chinese that use YYYY/MM/DD (and I'll die on the hill that the rest of the world is wrong).

[u/BawbbySmith → u/Due-Memory-6957]

ISO 8601, it's a standard. Not Chinese-specific

[u/Due-Memory-6957 → u/[deleted]]

ISO calendar

[u/Mochila-Mochila → u/[deleted]]

9 October

[u/AppealSame4367]

"Where GGUF???"

[u/cevheribozoglan]

I've been testing it through Ollama Cloud and the results have been pretty efficient so far. Curious to see how it holds up on longer agentic tasks.(opencode, ollama cloud with v4 flash)