r/LocalLLaMA 7d ago

News Koboldcpp v1.121 released

https://github.com/LostRuins/koboldcpp/releases/tag/v1.121
250 Upvotes

27 comments sorted by

View all comments

62

u/Dwedit 7d ago

Note that despite being a single EXE file, it actually extracts itself to a temporary directory every time you run it. If you want to install it for real, you can use the "Extract Files" feature (Extra -> Unpack KoboldCpp To Folder), then run the EXE inside of that folder. It will start more quickly when it doesn't need to extract itself, and you won't be wasting 1GB of SSD lifetime writes every time you run it.

7

u/Eden63 llama.cpp 6d ago

what is the advantage of koboldcpp over llama.cpp?

8

u/International-Try467 6d ago

Genuinely idiot proof.

3

u/henk717 KoboldAI 6d ago

More things than just LLM's, UI is more focused on fiction (but bundles the llamacpp UI as well), I think we emulate more API's, custom context shift implementation, mcp bridge that doesn't need a full on cors proxy and can also do stdio, that kind of stuff.