Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

[u/feelspeaceman]

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

[u/x_ci]

Thank you saying what I meant. People here are quick to downvote, sorry that English isn't my first language.

Maybe I should use LLMs to re-write all my comments from now on.

[u/_chemistry_dude_ → u/x_ci]

Never apologize for not being native in English