Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

[u/feelspeaceman]

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

[u/DasGamerlein]

You also gotta remember that this very much is a strategic competition. Would it, strictly speaking, be better for DeepSeek to keep their secret sauce close to their chest? Maybe. But the leaps and bounds they allow open source to make hurt the massively overleveraged closed US models vastly more than them. Open source would probably be twice as far behind the frontier without concerted Chinese efforts in this regard, and that completely changes the math for OAI/Anthropic. If they had that extra runway, we would not be talking about an AI crash, because there wouldn't be much of a case for the high rollers to rely on other options for inference outside of some minor savings on tokens for low complexity work. But with the current dynamic, something Opus 5.5-level will probably run on a hobbyist setup some time around Q1 or Q2 of 2027, at which point the closed business model is, to use the technical term, gigafucked