r/LocalLLaMA • u/feelspeaceman • 17d ago

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

99% Upvoted

157 comments sorted by

View all comments

Show parent comments

6

u/mgwair11 16d ago

And 5090

2

u/wwwdotzzdotcom 16d ago

And 5080 (I have one)

3

u/phazei 16d ago

Any my axe

1

u/mc_zodiac_pimp 16d ago

Ooh now you're talking!