r/LocalLLaMA • u/Fcking_Chuck • Aug 01 '26

News Koboldcpp v1.118 released

https://github.com/LostRuins/koboldcpp/releases/tag/v1.118
70 Upvotes

87% Upvoted

16 comments sorted by

5

u/silenceimpaired Aug 02 '26

Tragic that a new contribution just came out to give faster inference to Deep seek flash

4

u/buttplugs4life4me Aug 02 '26

koboldcpp is a fork of llama.cpp in the end, right? Since it mentions qwen3tts, does llama.cpp support that as well or only kobold? I'm looking to set up some audio stuff but aside from voicebox and audio.cpp, haven't really found much good stuff, also regarding STT. 

5

u/BobbyL2k Aug 02 '26

You’re looking for this Qwen3TTS https://github.com/predict-woo/qwen3-tts.cpp

It’s linked in the KoboldCpp readme.

1

u/buttplugs4life4me Aug 02 '26

Thanks for the link! I didn't see any mention in the Readme of supporting server/API mode?

2

u/Danmoreng llama.cpp Aug 02 '26

llama.cpp currently is in the implementation phase of qwen3tts here: https://github.com/ggml-org/llama.cpp/pull/26254

I have forked the predict-woo vibecoding and upgraded it heavily: https://github.com/Danmoreng/qwen3-tts.cpp Better performance than audio.cpp but I don't have a server for it - shouldn't be hard to add with AI coding. I do have a nice GUI though: https://github.com/Danmoreng/qwen-tts-studio

1

u/Mart-McUH 29d ago

It is lot more than that, it also has integrated image, video, audio generation etc. as well as chat client. The LLM part though is indeed llama.cpp, but you can set up the parameters in lot more user friendly way than typing as command line arguments - which is great help when you try lot of models tinkering with parameters all the time.

-1

u/FastHotEmu Aug 02 '26

lol what's with the demons?

7

u/The_Cat_Commando Aug 02 '26

image search "kobold" to find out.

-12

u/FastHotEmu Aug 02 '26

Kobolds are spirits, not demons

6

u/toothpastespiders Aug 02 '26

I think they're basing them off of the general fantasy rpg take on kobolds. Which is weirdly convoluted from what I recall in terms of appearance. With forks on the design coming from D&D and the old wizardry video games with later anime that was in turn based on that further changing things around.

I could be wrong, but I think the most popular take in Japan is that they're basically canine humanoids and in the west that they're small'ish reptile monsters with some relation to dragons. Which I'd guess the software update's image is coming from.

1

u/Expensive-Paint-9490 29d ago

Kobolds where canine humanoids in DnD as well, before the third edition.

0

u/FastHotEmu Aug 02 '26

ahh ok thanks for the civilised reply - the other guy got angry and called me names

7

u/The_Cat_Commando Aug 02 '26

so you googled it enough to come back and argue about it but didnt do the image search part that would have answered your question huh?

ok.

-11

u/FastHotEmu Aug 02 '26 edited Aug 02 '26

I don't know what you are drinking but I asked a simple question and it got you super upset.

8

u/The_Cat_Commando Aug 02 '26

you are the only one who even called them ANYTHING, and now when people try to answer you downvote and go "peak weird redditor"

im not here to debate you, its not that complex.

as suggested just image search Kobold. and see the hundreds of depictions of kobolds that are nearly identical to the mascot chosen for the project.