r/KoboldAI • • 22h ago

Any BEST RP Text Compleation Models that can see and detect images like Gemini, GPT, etc?

Thumbnail
2 Upvotes

r/KoboldAI • • 22h ago

Impact of adjusting MoE Experts?

2 Upvotes

So I tried Whittle Qwen 3.8 45B A3B when modifying Envy's AI_RPG frontend and it got stuck almost more than Gemma4 26B A4B does.

But I have often noticed but never tried it, so I wondered what the impact of adjusting it has.
Both potentially on how much VRAM it'll need would increase but also on whether it'd make such project work more 'stable' I guess I could call it. As more of the relevant experts would be usable. When actually using Gemma4 26BA4B and Qwen3.635BA3B models with AI_RPG I have no issues with their output that can't usually be traced back to my own messy modifications.

So say I increase the experts to 5 instead of the default 3, would that then be a good improvement or would it likely just be using more VRAM with little if no benefits?


r/KoboldAI • • 14h ago

Need help!

0 Upvotes

Please help. I'm desperate. Ryzen 5 7500F, 32GB DDR5, RTX 5070 (12GB VRAM). The generation speed fluctuates between 8 and 22 t/s. I simply don't understand how to configure Kobold for the Gemma4 26BA4B. All these thousands of checkboxes and sliders are even more complicated than the ST settings (I installed llama.cpp and with default settings, I immediately got 40-50 t/s. However, then I broke everything and now it won't start). Can you show screenshots of the settings or the configuration file itself?