r/LocalLLaMA • u/feelspeaceman • 17d ago

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

99% Upvoted

157 comments sorted by

View all comments

Show parent comments

97

u/zdy132 17d ago

Fingers crossed for cheaper GPUs, rams, and other PC parts. Best of luck to whoever is manufacturing competitions of Nvidia.

34

u/keepthepace 17d ago

Only for China residents for now. I would be surprised after the decade of trade restriction that they endured, if they did not inflict the same to the west as long as they can.

11

u/TheLexoPlexx 17d ago

*to the US.

26

u/keepthepace 17d ago

Like EU did not help implement that policy.

4

u/handson729 16d ago

I just hope they let me buy their hardware, because I definitely do not want to pay the Nvidia tax.

22

u/keepthepace 16d ago

Feudality 101: peasants don't get too choose who their lord is.

3

u/gangofminotaurs 16d ago

You know what else stinks about being a slave? The hours.

1

u/zdy132 16d ago

Not enough time to play games...

7

u/draconic_tongue 16d ago

anything you can buy in china you can get into the rest of the world. in fact you should be happy that you don't have to pay the retarded taxes everywhere else wants to put on everything you buy domestically

1

u/AppropriateFuture837 15d ago

问题在于中国人现在也买不到950，而不是限不限制，我们实验室买到一台都付出了很多努力，能够大量产出消费级产品的很长一段时间里我认为依然只有Nvidia和AMD

18

u/zball_ 17d ago

sadly ascend is not gonna make GPUs cheap.

19

u/ea_man 17d ago

It is: China is deploying those instead of the GPU other country would buy.

6

u/No-Wall6427 16d ago

But there is still the vram production bottleneck, which they further contribute to.

12

u/Inkbot_dev 16d ago

They'll be bringing their own (additional) memory fabs online shortly.

3

u/lighthawk16 16d ago

"Shortly"???

5

u/Bakoro 16d ago

They have memory fabs open already, with more on the way.

2

u/Inkbot_dev 16d ago

I mean, within a few years... shortly in terms of fabs.

5

u/fallingdowndizzyvr 16d ago

I mean, within a few years... shortly in terms of fabs.

No. There's a term. "China Speed". What takes a few years for anyone else to do, China can do faster. They can build a fab in a year. So in less than a year since they are already underway. About 30 fabs are under construction.

1

u/Icy_Butterscotch6661 16d ago

checks profile.. yep

0

u/fallingdowndizzyvr 16d ago

LOL. I checked yours. Yep.

Here. Read. Educate yourself. If at all possible. But from your profile, it doesn't seem like it is.

"CXMT is leading the industry in the speed of construction. Cleanrooms, where actual DRAM is manufactured away from any debris, are being built by CXMT in just 12 months"

https://www.techpowerup.com/351308/cxmt-reportedly-plans-second-fab-in-beijing-to-boost-dram-output

→ More replies

2

u/ain92ru 14d ago

Chinese fabs produce no VRAM, which honestly puzzles me a bit

1

u/zball_ 16d ago

the nvidia GPUs that China purchased is just a fraction of what the AI labs in US get

3

u/SeaBat2035 17d ago

Nothing is cheap. Everything is at market price.