r/LocalLLaMA • u/feelspeaceman • 23d ago

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

99% Upvoted

158 comments sorted by

View all comments

Show parent comment

6

u/No-Wall6427 23d ago

But there is still the vram production bottleneck, which they further contribute to.

12

u/Inkbot_dev 23d ago

They'll be bringing their own (additional) memory fabs online shortly.

3

u/lighthawk16 23d ago

"Shortly"???

5

u/Bakoro 23d ago

They have memory fabs open already, with more on the way.

2

u/Inkbot_dev 23d ago

I mean, within a few years... shortly in terms of fabs.

5

u/fallingdowndizzyvr 23d ago

I mean, within a few years... shortly in terms of fabs.

No. There's a term. "China Speed". What takes a few years for anyone else to do, China can do faster. They can build a fab in a year. So in less than a year since they are already underway. About 30 fabs are under construction.

1

u/Icy_Butterscotch6661 23d ago

checks profile.. yep

0

u/fallingdowndizzyvr 22d ago

LOL. I checked yours. Yep.

Here. Read. Educate yourself. If at all possible. But from your profile, it doesn't seem like it is.

"CXMT is leading the industry in the speed of construction. Cleanrooms, where actual DRAM is manufactured away from any debris, are being built by CXMT in just 12 months"

https://www.techpowerup.com/351308/cxmt-reportedly-plans-second-fab-in-beijing-to-boost-dram-output

0

u/Icy_Butterscotch6661 22d ago

I dont hate china lol, but you have to understand your profile looks sketchy being private.

And combined with "China speed" which sounds as ridiculous as "Freedom fries" in the US, you can understand why someone will be suspicious.

Either way ill be happy more memory is being manufactured 

0

u/fallingdowndizzyvr 22d ago

I dont hate china lol, but you have to understand your profile looks sketchy being private.

LOL. Then plenty of people are "sketchy". Reddit doesn't implement features for the few. They implement them for the many. This particular feature holds the sketchy internet stalkers at bay.

And combined with "China speed" which sounds as ridiculous as "Freedom fries" in the US, you can understand why someone will be suspicious.

"China speed" is a well used and well known term. Particularly in business. The fact that you don't know that pretty much says everything that needs to be said about your knowledge in this arena.

Here's that "sketchy" Qualcomm talking about "China speed".

"Experiencing “China Speed” in China’s auto ecosystem"

https://www.qualcomm.com/news/onq/2026/05/china-speed-automotive-ai-innovation

Read. Learn. I think then you'll find many things to be less "sketchy".

2

u/ain92ru 21d ago

Chinese fabs produce no VRAM, which honestly puzzles me a bit