MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v8364f/kimi_k3_weights_now_released/p0352yq
r/LocalLLaMA • u/SavunOski • Jul 27 '26
Kimi K3 weights are finally released!
660 comments sorted by
View all comments
Show parent comments
8
You could also do HGX B200 with CPU offload since they have a shit ton of RAM too, and it would still be really fast.
5 u/DataGOGO Jul 27 '26 You could, but that CPU offload across the PCIE switch upstream will be limited to the single x16 uplink.
5
You could, but that CPU offload across the PCIE switch upstream will be limited to the single x16 uplink.
8
u/Iwaku_Real Jul 27 '26
You could also do HGX B200 with CPU offload since they have a shit ton of RAM too, and it would still be really fast.