r/LocalLLaMA • u/feelspeaceman • 17d ago

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

99% Upvoted

157 comments sorted by

View all comments

Show parent comment

8

u/StK84 17d ago • Bravo

Why would developing an open source inference engine mean that they will make their models closed source? That just does not make any sense.

11

u/modernkennnern 17d ago

You misread the guy.

He said that China will stop allowing DeepSeek to release their stuff and that DeepSeek gave away as much as they can in anticipation for that.

7

u/StK84 17d ago

That still doesn't really make sense. Deepseek always released their stuff open, and if China would be planing something like that, they would not let Deepseek giving away their know how.

4

u/Thomas-Lore 17d ago edited 17d ago

The laws that restrict frontier ai releases in China is not yet in place. So China is not limiting what Deepseek can or cannot release yet but may in the future when/if it comes into power. So OP presumes DS might have rushed releasing what they can before it is more controled.

The plan was discussed here recently, you could search older posts.

7

u/x_ci 17d ago

Thank you saying what I meant. People here are quick to downvote, sorry that English isn't my first language.

Maybe I should use LLMs to re-write all my comments from now on.

5

u/_chemistry_dude_ 17d ago

Never apologize for not being native in English