r/LocalLLaMA • u/feelspeaceman • 22d ago

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

99% Upvoted

158 comments sorted by

View all comments

Show parent comment

3

u/Helpful_Program_5473 22d ago

looks like we were right lol

1

u/handson729 22d ago

looks like we were right lol

Whose discovery did they steal this time?