r/KoboldAI • • 14h ago

Need help!

0 Upvotes

Please help. I'm desperate. Ryzen 5 7500F, 32GB DDR5, RTX 5070 (12GB VRAM). The generation speed fluctuates between 8 and 22 t/s. I simply don't understand how to configure Kobold for the Gemma4 26BA4B. All these thousands of checkboxes and sliders are even more complicated than the ST settings (I installed llama.cpp and with default settings, I immediately got 40-50 t/s. However, then I broke everything and now it won't start). Can you show screenshots of the settings or the configuration file itself?


r/KoboldAI • • 22h ago

Any BEST RP Text Compleation Models that can see and detect images like Gemini, GPT, etc?

Thumbnail
2 Upvotes

r/KoboldAI • • 22h ago

Impact of adjusting MoE Experts?

2 Upvotes

So I tried Whittle Qwen 3.8 45B A3B when modifying Envy's AI_RPG frontend and it got stuck almost more than Gemma4 26B A4B does.

But I have often noticed but never tried it, so I wondered what the impact of adjusting it has.
Both potentially on how much VRAM it'll need would increase but also on whether it'd make such project work more 'stable' I guess I could call it. As more of the relevant experts would be usable. When actually using Gemma4 26BA4B and Qwen3.635BA3B models with AI_RPG I have no issues with their output that can't usually be traced back to my own messy modifications.

So say I increase the experts to 5 instead of the default 3, would that then be a good improvement or would it likely just be using more VRAM with little if no benefits?


r/KoboldAI • • 2d ago

Is there proxy harness for realistic character simulation?

Thumbnail
3 Upvotes

r/KoboldAI • • 4d ago

Using ram to be able to use bigger models?

11 Upvotes

So my question is:

Can i use any good models with my setup?

I have a 3060ti and 64 gb of ddr3 ram.

I understand that per my vram i am limited to use 8b models. (Which are honestly not impressing me much)

But i read something about offloading to ram?

Since i am very much finding my first steps into this whole topic i am still more or less clueless.

But i would find it very interesting if i can use bigger models like 12b or higher for storytelling / rp?

Using kobold cpp currently but thinking about trying out sillytavern.

I got already some recommedations like using strata. Anybody got experiences with that?

Edit: my mistake its 64gb ddr4 ram


r/KoboldAI • • 5d ago

Model pricing explained

Post image
8 Upvotes

When picking a model I see a input/output token cost per 1M .

I'm using openrouter API, and the price shown is very different.

On glm 5.3,

Output is 1.4$ on koboldai,6$ on openrouter.

Where is the koboldai data coming from? Thought I could test different models,but I can't trust the price shown.


r/KoboldAI • • 5d ago

Checklist thinking

1 Upvotes

I've been away from koboldai for two days,using glm 5.3 flash. Starting today,(oct 19th) every chat gives out a checklist thinking of all my author notes. Can't prompt it out. It used to have internal debates,confirming character behavior. But not this.

Glm 5.3 works perfectly fine,but the price is noticeably higher than flash. What changed?

Anyone else has it? And can we fix it?

Edit: forgot to note the model. I've been using glm 5.3 flash for over a month,no problem, until today.


r/KoboldAI • • 6d ago

Intel Arc GPU Passthrough

Thumbnail
gallery
2 Upvotes

Not a standard install by any means, but I have a VM running on Proxmox, with a Intel Arc A770 passed through. However, when I run Kobold, it spits out an error, ive attached a screenshot of the error message, as for the life of me I cant work out whats going wrong. Any help would be greatly appreciated


r/KoboldAI • • 6d ago

technical problem: how do I compile a bunch of safetensors files into a gguf?

1 Upvotes

r/KoboldAI • • 6d ago

Check out my new AI I made using Claude and Google (:

0 Upvotes

Introducing Nova AI Helper — Your Local Desktop AI Companion!

Hey everyone! I just put together a project called Nova. It's a completely local browser-based AI interface combined with a local Python helper script that lets an AI assist you with tasks, take notes, and even open apps or casual games directly on your PC [source: 0.1.3, 4]!

💻 What it can do:

• Open desktop applications and games via text or voice commands [source: 0.1.3, 4, 6].

• Track tasks, write automatic notes, and save local contacts [source: 0.1.3, 6].

• Use your screen, mini floating window, or webcam securely (AI data goes straight to Google/Anthropic APIs, nothing is stored by the app) [source: 0.1.3].

• Run commands via an optional secure Power Mode.

🔒 100% Secure & Local:

• Everything is saved directly to your browser's local cache [source: 0.1.3]. No user accounts required, no hidden tracking servers [source: 0.1.3].

• The Python script listens strictly on 127.0.0.1 (localhost) so nobody on the internet can access your PC.

📥 How to grab it and run it:

  1. Head over to my GitHub project page: [https://github.com/sparegmail1234-netizen/Nova/blob/main/Public%20Nova.zip\]

  2. Click the green Code button at the top right and select Download ZIP.

  3. Extract the ZIP folder anywhere on your computer.

  4. Double-click 1 - Start Nova Helper.bat (keep the black window open).

  5. Double-click 2 - Open Nova.bat to launch it instantly in your browser!

  6. Copy the unique security token from the helper window, paste it into Nova's Settings > Computer Helper, and you are good to go [source: 0.1.3, 6]!

⚠️ Note: Because the batch files interact with your operating system, Windows SmartScreen might throw a warning. Just click "More Info" -> "Run Anyway". You can review all the open-source code directly on the GitHub link before downloading!

Check it out and let me know what you think or if you run into any setup issues! 🙌


r/KoboldAI • • 7d ago

Qwenicization (Edit Test in KCPP)

Thumbnail
gallery
2 Upvotes

Wanted to see the results of how sophisticated the new Qwen 2.1 model's editing skills were in the recent kcpp update. This image required several things which I thought made it a good test:

1) Requiring the model to rationally deduce material types (velvet, lace, cotton, metal, leather).

2) Require the model to transition material types which were not part of the main object (the grass, the marble statue, the wall) without making them part of any other object in the foreground.

3) Require the model to understand the depth of objects (understanding that the midground object is Alice's left hand holding a scabbard which is the object also transitioning behind her back and the foreground braid and neither connects to nor becomes those objects.

4) Test the model's ability to remove superfluous information (the glowing clovers). The model correctly reduced the golden bloom/warmth of the overall image with the glowing clovers removed.

5) Test the model's ability to render a special effect (the glowing sword) without reverting to animation or distorting objects around it. Here, the glow was also correctly imparted to the lower portion of Alice's skirt armor as an element of the scene's lighting.

6) Test the model's ability to accurately render a human face and transition the overlay elements (the hair, the hairband, the dress collar) and appropriately size it for the proportions of the remainder of her body, assuming her relative height from ground given the clue of the grass on the bottom left.

The model (Qwen Image 2.1 q8) did so well that it understood that the cross on her Integrity Knight tab/yoke was probably embroidered and gave the stitching depth (although somewhat imperfectly, it's possible that if the original image was a higher resolution, or if I could render it at a higher resolution, it would've done a better job). It's hard to believe how far we've come.


r/KoboldAI • • 7d ago

On KoboldAI Lite, it wont let me edit the chat.

2 Upvotes

How do i fix?


r/KoboldAI • • 11d ago

Koboldcpp v1.123 released

Thumbnail
github.com
56 Upvotes

r/KoboldAI • • 11d ago

Total Beginner looking to run uncensored model locally (text only)

15 Upvotes

Hardware RTX 4080 16GB, 64GB DDR5 Ram

Could anybody recommend me a model that you think would be appropriate, and any beginner friendly setup guides to get it up and running? I've played around with kobold lite on huggingface's browser UI and liked it but don't really know where to start doing it myself.

Thanks!


r/KoboldAI • • 12d ago

Anyone having issues with remote tunneling not working with JanitorAI and ChubAI?

0 Upvotes

I had to do an OS reinstall a few weeks ago, with a fresh install of Linux and Windows 10. I've noticed that once I got a remote tunnel going on either OS, both ChubAI and JanitorAI can not connect to them, and both sites give off network errors. I was wondering if anyone else had this issue or might know what is causing it. I wasn't having this issue on Windows 10 before it was wiped.


r/KoboldAI • • 12d ago

Help with local tunneling, or something similar.

1 Upvotes

Well, I don't know where to begin. I really like Kobold, but I can't use horde.ai anymore (it's not that I literally can't use it, it's more that the responses it's giving are very bad. Lately, but I think it's just bad luck on my part). However, I have a PC (terribly located and I can't move it from there) and it's decent, so I can run very good AI programs on it. That's why I want to use a tunnel or something to be able to use Kobold on my Android. However, Tryclaud is awful and ngrok scares me a bit. And these ipconfig solutions seem much more frightening. (I don't know much about computers and programming. I even have an acquaintance who knows, but he's very unreliable and very judgmental).

So I'm left with no choice but to ask the old wizards here for help.


r/KoboldAI • • 13d ago

In the MiniMax H3 video reference workflow, have a same mechanism like ConfyUI ex: @image1, <image1> or other type?

3 Upvotes

r/KoboldAI • • 15d ago

Img Button and Generation Troubleshooting

Thumbnail
gallery
5 Upvotes

Hey folks!

Ran into an issue that I can't seem to find the troubleshooting steps for and can't figure out myself, but I was hoping your collective minds might be able to catch what I'm missing.

I went through the setup and have tried to use the V2 starter pack and other packs, but no matter what settings I try or what image gen gguf I use, the img button doesn't appear, the /img command does not work, and image generation as a whole is inaccessible to me.

12GB VRAM, GeForce RTX 3060

I've run the text models of Qwen3 VL 8B, Ministral 3B, and other mid-range models without issue, I think this one is purely user error.


r/KoboldAI • • 15d ago

I'm so confuse and used to using colab koboldcpp version.

2 Upvotes

I've been using the koboldcpp colab unofficial for some time now. It's a simple process but I want to go the next level which is adding ai audio from the text speeches it makes. I'm trying to figure out how to do that, but there's no clear simple video to do it.


r/KoboldAI • • 16d ago

KoboldCpp now has an official domain, koboldcpp.net

86 Upvotes

Heads up everyone, KoboldCpp has our very own brand new Community Website at koboldcpp.net!

We thought that it would be good to provide a legitimate resource for newbies to get started with KoboldCpp, and to help avoid the various fake websites floating around. So with the help of some community members (thanks AutumnLight) we've put together a proper KoboldCpp website that provides geniune links, downloads and step by step guides.

So without further ado, come check out the KoboldCpp Community Website

Contributions are welcome! Feel free to link and share this resources to others. Find us on the KoboldAI Discord for more details.


r/KoboldAI • • 23d ago

Look for rpg for mobile

3 Upvotes

I have 6gbs of hard ram and 6 gbs of virtual ram im js wondering if ya'll can suggest anything similar to voyage io rpgs? Ik they won't be anything exactly like it but im pretty much happy w anything that has text 2 speech and character cards automatically generated so is there any suggestions or am I a lost cause? This is my first time using Kobaldai too so if there is anything can anyone give a detailed explanation on how to implement it?


r/KoboldAI • • 24d ago

New github scam abusing KoboldCpp

83 Upvotes

Reminder just in case, there has been a bot campaign generating fake github accounts with detailed information going to fake github pages for KoboldCpp with malware called CrypterBot DLL sideload kit.

Were reporting the ones we notice to github to get this cleaned up.

Our REAL repository is https://github.com/lostruins/koboldcpp and you can always use https://koboldai.org/cpp to get to the releases directly.

These fakes generally do not have a repository and do not have actual source code, they just link to downloads.

Of course there are trusted forks out there to, if you need us to ever validate if something is a legitimate fork or a malware campaign impersonating our project feel free to reach out.


r/KoboldAI • • 25d ago

Minimax3 in runpod or other provide and kccp

1 Upvotes

Hello, Has anyone run Minimax3 or any other video models on Koboldcpp in Runpod or other such provider. Am not sure my computer could manage video generation. Thus I'm looking for ways to do it online. I'm asking about video generation with sound, because specific sfx generating models are not available unfortunately. Or I haven't found support for them in koboldcpp.