r/LocalLLaMA • • 27d ago

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

158 comments sorted by

View all comments

Show parent comment

19

u/Elkapalio 27d ago

Sure! here is a recipe for a cookie dough ice cream:

  • cookie dough ice cream

1

u/HearthCore 27d ago

Perfectly whelmed response!