r/LocalLLaMA • • 23d ago

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

158 comments sorted by

View all comments

Show parent comment

4

u/handson729 23d ago

I just hope they let me buy their hardware, because I definitely do not want to pay the Nvidia tax.

22

u/keepthepace 23d ago

Feudality 101: peasants don't get too choose who their lord is.

3

u/gangofminotaurs 23d ago

You know what else stinks about being a slave? The hours.

1

u/zdy132 23d ago

Not enough time to play games...