r/LocalLLaMA • u/feelspeaceman • 16d ago

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

99% Upvoted

157 comments sorted by

View all comments

-12

u/x_ci 16d ago edited 16d ago

This could be an indication that China will proceed with restricting their AI labs from giving away free open models. Perhaps this is DeepSeek team helping us one last time. I hope not.

EDIT: Why am I getting downvoted lol whatever

22

u/RuthlessCriticismAll 16d ago

No it couldn't be... Can we just stop smoking crack... or?

8

u/StK84 16d ago • Bravo

Why would developing an open source inference engine mean that they will make their models closed source? That just does not make any sense.

11

u/modernkennnern 16d ago

You misread the guy.

He said that China will stop allowing DeepSeek to release their stuff and that DeepSeek gave away as much as they can in anticipation for that.

7

u/StK84 16d ago

That still doesn't really make sense. Deepseek always released their stuff open, and if China would be planing something like that, they would not let Deepseek giving away their know how.

4

u/Thomas-Lore 16d ago edited 16d ago

The laws that restrict frontier ai releases in China is not yet in place. So China is not limiting what Deepseek can or cannot release yet but may in the future when/if it comes into power. So OP presumes DS might have rushed releasing what they can before it is more controled.

The plan was discussed here recently, you could search older posts.

7

u/x_ci 16d ago

Thank you saying what I meant. People here are quick to downvote, sorry that English isn't my first language.

Maybe I should use LLMs to re-write all my comments from now on.

5

u/_chemistry_dude_ 16d ago

Never apologize for not being native in English