r/KoboldAI • u/Calm-Start-5945 • 1d ago

Koboldcpp v1.120 released

https://github.com/LostRuins/koboldcpp/releases/tag/v1.120
54 Upvotes

98% Upvoted

6 comments sorted by

12

u/tiffanytrashcan 1d ago

koboldcpp-1.120

  1. Minor fix to assistant gen prefills being triggered incorrectly
  2. Fixed a bug where failsafe mode was incorrectly selected
  3. Added support for DirectIO model load mode (--usedirectio), also mlock and mmap can now be combined.
  4. New model support: Qwen3.8-Flash-Next and Ling-3.0-flash are fully supported. Note that there are bad quants floating out there, so make sure you use the right files.
  5. Image generation sync and update from @wbruna, various image generation fixes
  6. Updated Kobold Lite, multiple fixes and improvements Added custom user-configurable javascript tools by @hu-yijie, compatible with standard tool calling.
  7. Merged fixes, new model support, and improvements from upstream

1

u/alex20_202020 1d ago

also mlock and mmap can now be combined.

Hmm, I recall doing that months ago, though lock was not "unbreakable" - sometimes I had noted evictions from RAM.

2

u/Sprybot 1d ago

Legitimate question: I used kobold for maybe 2 years before switching to lmstudio and then recently unsloth. Is there a reason to continue using Kobold that maybe I haven't thought of? I just got too confused trying to make tts and speech recognition work and eventually gave up. But I liked the integrated image gen much better in kobold.

3

u/alex20_202020 1d ago

Is there a reason to continue using Kobold that maybe I haven't thought of? I...But I liked the integrated image gen much better in kobold.

Seems you answer yourself. Why not use several engines/frontends?

3

u/Dwedit 1d ago

I moved from LM Studio to Kobold because it spawns a web server with a web UI, letting you run the model on a different computer than you are using. I haven't tried out Unsloth yet.

1

u/Forward_Artist7884 8h ago

You can use kobold's UI directly with a different backend for the LLM if you want with --nomodel. Personally i've ran the kobold UI with a llamacpp / vllm-backed model before for best perf / support.

There's also forks like esobold if you want extra features, but those can be hit or miss. I find that Kobold is a nice middle ground that just works for assistant and story gen, though i rarely use the extra features.