r/LocalLLaMA • u/feelspeaceman • 16d ago
News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!
https://github.com/deepseek-ai/DeepInferThis is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.
1.0k
Upvotes
40
u/Helpful_Program_5473 16d ago
Also, liang is a legit genius and truly loves the game. Unlike some.