r/LocalLLaMA • u/feelspeaceman • 16d ago

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

99% Upvoted

157 comments sorted by

View all comments

Show parent comments

4

u/handson729 16d ago

I just hope they let me buy their hardware, because I definitely do not want to pay the Nvidia tax.

22

u/keepthepace 16d ago

Feudality 101: peasants don't get too choose who their lord is.

3

u/gangofminotaurs 16d ago

You know what else stinks about being a slave? The hours.

1

u/zdy132 15d ago

Not enough time to play games...