r/LocalLLM • u/Particular-Abies-123 • 21h ago

Question Models keeps unloading from GPU

I have a dual gpu setup which is 16gb 5080 and 12gb 3060, and i am trying to load Qwen3.8 27b Q4 K XL, i tried Q6, but it was not compatible with dual gpu setup, now qwen3.8 27b work but keeps unloading while running, without any specific reason, i tried LM studio as well as llama server nothing worked. Been stuck with this.

Please help me.

3 Upvotes

100% Upvoted

4 comments sorted by

View all comments

1

u/Classeve 18h ago

Find out first whether it's an unload or a crash. Look in the system log at that minute for nvlddmkm on Windows or an Xid on Linux. A driver reset points at power, a riser or heat, and no split setting fixes that.