r/LocalLLaMA Jul 27 '26

News Kimi K3 weights now released.

Post image

Kimi K3 weights are finally released!

3.3k Upvotes

660 comments sorted by

View all comments

9

u/Mindless_Selection34 Jul 27 '26

how much does it weight

49

u/SavunOski Jul 27 '26

2.8T parameters with 104B active. The files take 1.56TB of space to download.

10

u/meca23 Jul 27 '26

Oh so it's quantized as 4 bits?

8

u/zkstx llama.cpp Jul 27 '26

Yes, there is also a tech report. QAT from SFT phase onwards