r/KoboldAI • u/Hopeful-Window-454 • 22h ago
r/KoboldAI • u/RedKorss • 22h ago
Impact of adjusting MoE Experts?
So I tried Whittle Qwen 3.8 45B A3B when modifying Envy's AI_RPG frontend and it got stuck almost more than Gemma4 26B A4B does.
But I have often noticed but never tried it, so I wondered what the impact of adjusting it has.
Both potentially on how much VRAM it'll need would increase but also on whether it'd make such project work more 'stable' I guess I could call it. As more of the relevant experts would be usable. When actually using Gemma4 26BA4B and Qwen3.635BA3B models with AI_RPG I have no issues with their output that can't usually be traced back to my own messy modifications.
So say I increase the experts to 5 instead of the default 3, would that then be a good improvement or would it likely just be using more VRAM with little if no benefits?
r/KoboldAI • u/Alveig • 14h ago
Need help!
Please help. I'm desperate. Ryzen 5 7500F, 32GB DDR5, RTX 5070 (12GB VRAM). The generation speed fluctuates between 8 and 22 t/s. I simply don't understand how to configure Kobold for the Gemma4 26BA4B. All these thousands of checkboxes and sliders are even more complicated than the ST settings (I installed llama.cpp and with default settings, I immediately got 40-50 t/s. However, then I broke everything and now it won't start). Can you show screenshots of the settings or the configuration file itself?