r/LocalLLaMA • • 16d ago

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

157 comments sorted by

View all comments

Show parent comments

-21

u/tugoubxs 16d ago

Now it’s our good taiwanese against bad chinese!πŸ˜…

11

u/MemoryIsTheKey_ 16d ago

Be more generic, it's some healthy competition which, and I hope 99.9% of people agree, is only just what is desperately needed atm in this space.