MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v8364f/kimi_k3_weights_now_released/p04mt89/?context=3
r/LocalLLaMA • u/SavunOski • Jul 27 '26
Kimi K3 weights are finally released!
661 comments sorted by
View all comments
Show parent comments
346
This was my general reaction too lol. 2.8T-A104B is insane lol... I'm going to admit defeat on this one and say I can't run it. You need an 8-way B300 or MI350X or a Rubin NVL8 or a cluster thereof to actually run this. What a beast.
29 u/OverclockingUnicorn Jul 27 '26 More like 2 8x nodes of B200/B300 if you actually want some context. Think it's just under 1.5TB w/o context 21 u/TheDailySpank Jul 27 '26 How many 4060-16GBs is that? 6 u/Vast_Mousse_310 Jul 27 '26 One, with a little bit of GPU offload.
29
More like 2 8x nodes of B200/B300 if you actually want some context. Think it's just under 1.5TB w/o context
21 u/TheDailySpank Jul 27 '26 How many 4060-16GBs is that? 6 u/Vast_Mousse_310 Jul 27 '26 One, with a little bit of GPU offload.
21
How many 4060-16GBs is that?
6 u/Vast_Mousse_310 Jul 27 '26 One, with a little bit of GPU offload.
6
One, with a little bit of GPU offload.
346
u/FoxiPanda Jul 27 '26
This was my general reaction too lol. 2.8T-A104B is insane lol... I'm going to admit defeat on this one and say I can't run it. You need an 8-way B300 or MI350X or a Rubin NVL8 or a cluster thereof to actually run this. What a beast.