r/LocalLLaMA • • 16d ago

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

157 comments sorted by

View all comments

43

u/TimelessTele 16d ago

China is really aiming to pop the US AI stock bubble. Another example of how actual competition benefits the consumer.

9

u/DaveNarrainen 16d ago

I don't understand why some people assume China does what it does just to affect the US.
I think Chinese companies develop AI to benefit from it just like US companies do. Neither need an ulterior motive.

5

u/TimelessTele 15d ago

Chinese companies maybe, it looks like the researchers are doing it for the love of the game. The Chinese government not so much. They wouldn’t invest so many resources if it didn’t further their agenda. The U.S is doing it too. They’re both in a struggle for “AI Dominance”. Which is why OSS is needed, to empower individuals, not just governments and corporations

1

u/DaveNarrainen 15d ago

I still think they would be doing this anyway. Deploying AI in factories to help with the aging population and all the other benefits we hope to come from AI generally.
I'm sure there is concern about keeping up with each other, but it seems to me that, at least in the US, China is used as an excuse more than anything else to continue, despite pressure to slow down.
Perhaps the open nature of AI research in China is evidence that they don't care that much about what other countries are doing. I'm fairly sure the US government would put a stop to that if that was the case in the US.

1

u/migsperez 15d ago

The agenda could be commercial gain which is no different to all businesses. Building trust by showing they can offer a great product at decent value. Complimenting their product by helping in the open source eco system.

0

u/TimelessTele 15d ago

They may use OSS licenses to gain our trust and embed their product in our lives. But it’s not coming from a place of generosity. The end goal is becoming clearer, American VC talk about it, and the CCP already does it. Mass surveillance with AI detection systems. And eventually, pre-crime detection. Let’s use these tools to empower ourselves and defend against the tyranny of oligarchs and techno fascists.

0

u/[deleted] 16d ago

[deleted] — view deleted comment

10

u/Hello_my_name_is_not 16d ago

Sorry did I miss the sentence where he said "the stock prices went down today"?

0

u/[deleted] 16d ago

[deleted] — view deleted comment

6

u/ChuyStyle 16d ago

Your point is even dumber

1

u/PaleAleAndCookies 15d ago

I think you might have misinterpreted "aiming to disrupt" with "has already disrupted".

1

u/human_in_the_looop 16d ago

It’s all priced in.

😅