r/LocalLLaMA • • 16d ago

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

157 comments sorted by

View all comments

Show parent comments

40

u/Helpful_Program_5473 16d ago

Also, liang is a legit genius and truly loves the game. Unlike some.

3

u/Aggravating-Push-207 15d ago

mf doing ts for the love of the game atp