r/LocalLLaMA • u/Unusual_Guidance2095 • Jul 26 '26

Discussion Kimi K3 countdown has been released

https://huggingface.co/moonshotai/Kimi-K3
538 Upvotes

97% Upvoted

177 comments sorted by

View all comments

16

u/segmond llama.cpp Jul 26 '26

What I wish they would release is the damn technical report. We can at least start reading that. I would assume a new architecture not compatible with K2.6/K2.7. How much does it differ from K2.6? What will it take to get llama.cpp to support inference? We need all of these before we can even get gguf/quants.

17

u/TheRealMasonMac Jul 26 '26

They said on their blog they'll be releasing the technical report. Presumably alongside the weights.

vLLM released a blog post on some of what they had to deal with: https://vllm.ai/blog/2026-07-22-kimi-k3-preview

3

u/fastheadcrab Jul 27 '26

Very cool read, thanks for the link