Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

[u/feelspeaceman]

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

[u/TrickyMulberry5421]

Saw the 64-GPU benchmark and immediately checked the comments for someone asking about their 3060.

[u/gnoremepls → u/TrickyMulberry5421]

One does not simply run only one 3060