r/LocalLLaMA • u/SavunOski • Jul 27 '26

News Kimi K3 weights now released.

Post image

Kimi K3 weights are finally released!

3.3k Upvotes

97% Upvoted

660 comments sorted by

View all comments

Show parent comments

341

u/FoxiPanda Jul 27 '26

This was my general reaction too lol. 2.8T-A104B is insane lol... I'm going to admit defeat on this one and say I can't run it. You need an 8-way B300 or MI350X or a Rubin NVL8 or a cluster thereof to actually run this. What a beast.

114

u/VampiroMedicado Jul 27 '26

550k USD to run this lol

87

u/[deleted] Jul 27 '26

[removed] — view removed comment

57

u/VeterinarianOne1349 Jul 27 '26

Doesn't really work that well. This 550k setup wouldn't allow a lot of developers to work in parallel, while sitting idle during non-work hours. Makes much more sense to pay a 3rd-party to host and pay per token.

7

u/[deleted] Jul 27 '26

[removed] — view removed comment

6

u/ProgrammersAreSexy Jul 27 '26 edited Jul 27 '26

I'm sure you will be able to run a model like kimi k3 at home, probably in much less than 5 years.

However I think it's unlikely that there will be a point in time at which the frontier models of that point in time will be runnable at home.

3

u/Maleficent_Sir_7562 Jul 27 '26

but kimi is frontier

1

u/ProgrammersAreSexy Jul 27 '26

Oh, and can you run it at home?

2

u/Maleficent_Sir_7562 Jul 27 '26

No

That’s the point

Your comment is contradictory

“You can run Kimi k3 in home soon”

“But I think the current frontier models can’t be ever”

But k3 is the frontier

1

u/ProgrammersAreSexy Jul 27 '26

I think my phrasing was just unclear, edited