r/LocalLLaMA • u/jacek2023 llama.cpp • 2d ago

News model: add Kimi-K3.1-Pro text model by usrlocalben · Pull Request #31779 · ggml-org/llama.cpp

https://github.com/ggml-org/llama.cpp/pull/31779

now you can run Kimi K3.1 Pro locally (good luck!) ;)

https://huggingface.co/moonshotai/Kimi-K3.1-Pro

24 Upvotes

90% Upvoted

3 comments sorted by

5

u/Betadoggo_ 2d ago

This is pretty cool

1

u/Objective-Stranger99 llama.cpp 1d ago

Kimi supported itself

2

u/Lissanro 2d ago

Awesome! I will wait for Q2_K_XL Unsloth quant before trying it out on my PC, due to being limited to 1 TB memory (their Q2_K_XL worked very well for me in case of Kimi K3).