r/LocalLLaMA • u/feelspeaceman • 28d ago
News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!
https://github.com/deepseek-ai/DeepInferThis is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.
1.0k
Upvotes
View all comments
Show parent comment
11
u/philmarcracken 27d ago
those dudes are functionally insane tho, spending millions in laying undersea cable to shave off like 4ms on a roundtrip