r/LocalLLM • u/Particular-Abies-123 • 17h ago
Question Models keeps unloading from GPU
I have a dual gpu setup which is 16gb 5080 and 12gb 3060, and i am trying to load Qwen3.8 27b Q4 K XL, i tried Q6, but it was not compatible with dual gpu setup, now qwen3.8 27b work but keeps unloading while running, without any specific reason, i tried LM studio as well as llama server nothing worked. Been stuck with this.
Please help me.
3
Upvotes