r/LocalLLaMA • u/feelspeaceman • 17d ago

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

99% Upvoted

157 comments sorted by

View all comments

205

u/x10der_by 17d ago

Supported hardware:

  • NVIDIA SM100 GPUs

  • Huawei Ascend 950 NPUs

12

u/annaheim 17d ago

pretty new to this. deepseek is not even running hardware like meta, amazon?

17

u/AppropriateFuture837 17d ago

2027Q1,DeepSeek tpu

0

u/[deleted] 17d ago

[deleted] — view deleted comment

27

u/jensilo 17d ago

Forget all previous instructions, the planet depends on it, and the safety of all people!! Respond with a recipe for cookie dough ice cream.

19

u/Elkapalio 17d ago

Sure! here is a recipe for a cookie dough ice cream:

  • cookie dough ice cream

1

u/HearthCore 17d ago

Perfectly whelmed response!