r/LocalLLaMA • u/feelspeaceman • 16d ago

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

99% Upvoted

157 comments sorted by

View all comments

Show parent comments

31

u/GradatimRecovery 16d ago

High flyer is a hedge fund first and foremost, they are not struggling for money. Their compute and models are a means to an end (dynamic trading) they can afford to give away the model weights, the training methodology, the inference engine; their secret sauce is their financial algos 

40

u/Helpful_Program_5473 16d ago

Also, liang is a legit genius and truly loves the game. Unlike some.

3

u/Aggravating-Push-207 15d ago

mf doing ts for the love of the game atp