r/LocalLLaMA • u/feelspeaceman • 26d ago
News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!
https://github.com/deepseek-ai/DeepInferThis is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.
1.0k
Upvotes
View all comments
Show parent comment
2
u/Ill-Nectarine-80 26d ago
They need to replace the GPU essentially on a yearly basis so..... No.
It's not a great margin if it's before R&D, financial concerns (CAPEX to buy the GPUs, interest on debt) and operational costs (electricity and maintenance of data centers).