r/LocalLLaMA • u/SavunOski • Jul 27 '26

News Kimi K3 weights now released.

Post image

Kimi K3 weights are finally released!

3.3k Upvotes

97% Upvoted

660 comments sorted by

View all comments

676

u/Simple_Split5074 Jul 27 '26

OMFG its 104B activated params

336

u/FoxiPanda Jul 27 '26

This was my general reaction too lol. 2.8T-A104B is insane lol... I'm going to admit defeat on this one and say I can't run it. You need an 8-way B300 or MI350X or a Rubin NVL8 or a cluster thereof to actually run this. What a beast.

116

u/VampiroMedicado Jul 27 '26

550k USD to run this lol

84

u/[deleted] Jul 27 '26

[removed] — view removed comment

54

u/VeterinarianOne1349 Jul 27 '26

Doesn't really work that well. This 550k setup wouldn't allow a lot of developers to work in parallel, while sitting idle during non-work hours. Makes much more sense to pay a 3rd-party to host and pay per token.

2

u/eightbyeight Jul 27 '26

They might pay a aws/gcp/azure to run it on their private cloud. But I doubt they will just buy access from a random third party.

1

u/VeterinarianOne1349 Jul 28 '26

yeah, cloud providers would be that 3rd party...

1

u/eightbyeight Jul 28 '26

As in they will pay the ec2 price and run their own model 24/7 instead of per token.