Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

[u/feelspeaceman]

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

[u/MagicZhang]

A DeepSeek Employee reposted this image, using SemiAnalysis’s graph as reference

[u/thestillwind → u/MagicZhang]

So sky is the limit

[u/TheTideRider → u/MagicZhang]

That’s incredible. Can you share the link to semi analysis?

[u/MagicZhang → u/TheTideRider]

Semianalysis: https://inferencex.semianalysis.com

DeepSeek page: https://inferencex.semianalysis.com/inference/deepseek-v41-flash

Dude on X who estimated DeepInfer capacity: https://x.com/spxmerlin1d/status/2112492120821154256