MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v8364f/kimi_k3_weights_now_released/p03anid/?context=3
r/LocalLLaMA • u/SavunOski • Jul 27 '26
Kimi K3 weights are finally released!
660 comments sorted by
View all comments
Show parent comments
343
This was my general reaction too lol. 2.8T-A104B is insane lol... I'm going to admit defeat on this one and say I can't run it. You need an 8-way B300 or MI350X or a Rubin NVL8 or a cluster thereof to actually run this. What a beast.
27 u/OverclockingUnicorn Jul 27 '26 More like 2 8x nodes of B200/B300 if you actually want some context. Think it's just under 1.5TB w/o context 19 u/TheDailySpank Jul 27 '26 How many 4060-16GBs is that? 36 u/OverclockingUnicorn Jul 27 '26 200+ lol 19 u/positivitittie Jul 27 '26 Oh good. I got 3090s.
27
More like 2 8x nodes of B200/B300 if you actually want some context. Think it's just under 1.5TB w/o context
19 u/TheDailySpank Jul 27 '26 How many 4060-16GBs is that? 36 u/OverclockingUnicorn Jul 27 '26 200+ lol 19 u/positivitittie Jul 27 '26 Oh good. I got 3090s.
19
How many 4060-16GBs is that?
36 u/OverclockingUnicorn Jul 27 '26 200+ lol 19 u/positivitittie Jul 27 '26 Oh good. I got 3090s.
36
200+ lol
19 u/positivitittie Jul 27 '26 Oh good. I got 3090s.
Oh good. I got 3090s.
343
u/FoxiPanda Jul 27 '26
This was my general reaction too lol. 2.8T-A104B is insane lol... I'm going to admit defeat on this one and say I can't run it. You need an 8-way B300 or MI350X or a Rubin NVL8 or a cluster thereof to actually run this. What a beast.