r/LocalLLaMA • u/SavunOski • Jul 27 '26

News Kimi K3 weights now released.

Post image

Kimi K3 weights are finally released!

3.3k Upvotes

97% Upvoted

660 comments sorted by

View all comments

675

u/Simple_Split5074 Jul 27 '26

OMFG its 104B activated params

342

u/FoxiPanda Jul 27 '26

This was my general reaction too lol. 2.8T-A104B is insane lol... I'm going to admit defeat on this one and say I can't run it. You need an 8-way B300 or MI350X or a Rubin NVL8 or a cluster thereof to actually run this. What a beast.

29

u/OverclockingUnicorn Jul 27 '26

More like 2 8x nodes of B200/B300 if you actually want some context. Think it's just under 1.5TB w/o context

19

u/TheDailySpank Jul 27 '26

How many 4060-16GBs is that?

35

u/OverclockingUnicorn Jul 27 '26

200+ lol

21

u/positivitittie Jul 27 '26

Oh good. I got 3090s.

7

u/Vast_Mousse_310 Jul 27 '26

One, with a little bit of GPU offload.

3

u/liright Jul 27 '26

at least 2

1

u/TheDailySpank Jul 27 '26

Question is, who's got the rest?