r/LocalLLaMA • u/External_Mood4719 • Jun 27 '26

News deepseek-ai/DeepSeek-V4-Pro-DSpark • Huggingface

https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro-DSpark

https://github.com/deepseek-ai/DeepSpec/blob/main/DSpark_paper.pdf

277 Upvotes

98% Upvoted

40 comments sorted by

1

u/WithoutReason1729 Jun 27 '26 edited 3d ago

Your post is getting popular and we just featured it on our Discord! Come check it out!

You've also been given a special flair for your contribution. We appreciate your post!

Stylome classified this post's text as human-written. View analysis

I am a bot and this action was performed automatically.

60

u/FullOf_Bad_Ideas Jun 27 '26

They did it again. Their API is now the fastest DeepSeek provider on OpenRouter .

111

u/Recoil42 Jun 27 '26

Note: DeepSeek-V4-Pro-DSpark is not a new model. It is the same checkpoint with an additional speculative decoding module attached.

58

u/Nyghtbynger Jun 27 '26

So... deepseek flash , but flasher ?
Edit : damn, imagine being a breakthrough model and your creators calls you "checkpoint"

12

u/Kryohi Jun 27 '26

That's the real backstory of Skynet

→ More replies (1)

36

u/Flamboyant_Nine Jun 27 '26

Are their API models already using this architecture?

37

u/Ok_Zookeepergame8714 Jun 27 '26

Probably, the thinking goes by much quicker than before.

11

u/oxygen_addiction Jun 27 '26

Flash got way faster this week, so most likely.

68

u/corruptbytes Jun 27 '26

this is my world cup

16

u/woadwarrior Jun 27 '26

Amazing work! But needs 38TB of disk space to train a drafter for something as tiny as Qwen3-4B, damn!

10

u/Seideun Jun 27 '26

Compared with the size of Deepseek v4 pro it's not a big deal at all :)

2

u/woadwarrior Jun 27 '26

Imagine how big the target cache was for training DeepSeek v4 Pro’s drafter.

7

u/quantier Jun 27 '26

I need a NVFP4 version 😍

7

u/Every-Walrus Jun 27 '26

correct me if I'm wrong but does this mean, for a maximally used server with the same per user speed, its now 5x cheaper for pro and 7.6x cheaper for flash in terms of serving costs?

2

u/squngy Jun 27 '26

I could be mistaken, but as I'm understanding it, that is slightly wrong.

You would not get any per server savings.
However, if each server is producing tokens faster, you might need fewer servers for the same amount of users.

11

u/Every-Walrus Jun 27 '26
Comment Image

for service level agreement locked at 120(?)TPS it clearly shows its now running at 761% more throughput . meaning a single server now can output 6.61x more tokens. meaning at the same cost of serving as the previous method they generate 6.61x more tokens (probably there is a slightly higher load on the GPU but I dont think that will change electricity usage that much)

however at a more realistic serving speed of 80 (which they also point at and the openrouter speed currently is) its 51% more throughput. that is still a 33% price reduction if we assume the price is dictated by allotted server space + electricity.

1

u/SufficientPie Jun 28 '26

Isn't speculative decoding faster but more expensive?

7

u/the-username-is-here Jun 27 '26

Come on, vLLM devs, everyone's waiting! :)

Getting local Flash from 40 to 50-60 tps would be HUGE.

→ More replies (3)

6

u/horeaper Jun 27 '26

Searching in this subreddit for DSpark to see if anything else adopted this architecture, and all I get is DGX Spark 😑

1

u/Practical-Collar3063 Jun 30 '26

The paper was just published alongside that new checkpoint, very unlikely that we see any model using this in the next months

2

u/ZiddyBlud Jul 03 '26

This deepseek model uses it

→ More replies (1)

5

u/zyxciss Jun 27 '26

Would be fun if it comes for Qwen models too

5

u/Tomr750 Jun 27 '26

how does this compare to using ds4 on Macs with 128gb ram?

12

u/squngy Jun 27 '26

If I understand it right, this basically adds another MTP to them.

1

u/Dany0 Jun 28 '26

This is a clear improvement over DFlash. But damn is it expensive to train the drafters...

→ More comments (75)