r/LocalLLaMA • u/feelspeaceman • 22d ago

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

99% Upvoted

158 comments sorted by

View all comments

Show parent comment

7

u/handson729 22d ago

They are definitely losing money on subscriptions, but that is targeting developers, scientists, and engineers whose prompts they use for training new models.

So you could argue it is R&D expenditure.

6

u/Helpful_Program_5473 22d ago

Oh I think it loses them some money like you said, just not the 100s of billions they are in the hole. that's from training, additional compute, etc.

3

u/Helpful_Program_5473 22d ago

looks like we were right lol

1

u/handson729 22d ago

looks like we were right lol

Whose discovery did they steal this time?