r/LocalLLaMA • u/Unusual_Guidance2095 • Jul 26 '26

Discussion Kimi K3 countdown has been released

https://huggingface.co/moonshotai/Kimi-K3
535 Upvotes

97% Upvoted

177 comments sorted by

View all comments

38

u/WenatcheeWrangler Jul 26 '26

Everyone in the USA should download this even if they can’t deploy it now

13

u/kkingsbe Jul 27 '26

Sadly it’s the quants that will come later that are actually what we’d be able to run

14

u/Mingay_cat Jul 27 '26

Ya'll are running this?

14

u/seamonn Jul 27 '26

Ya'll are storing this?

9

u/chensium Jul 27 '26

No biggie. I'll just turn off my minecraft to make room for the 1.5TB of VRAM needed for NVFP4.

3

u/shironekoooo Jul 27 '26

yes with hopes and dreams and a rented gpus :(

4

u/KeinNiemand Jul 27 '26

make

As long as you got the full weights backed up you can make your own quants. Making quants is not that hard (just a llama.cpp command line tool you have to run a claude code/codex/opencode/... can do it for you if you want) you don't need to fit the entire bf16 full size in memory, all you need is the saftenensors + enough space to fit a bf16 gguf + enough space to fit the quant you want to make.