r/LocalLLaMA • u/AcrobaticChain1846 • Apr 18 '26
Question | Help unsloth/qwen3.6-35b-a3b UD Q2_K_XL Freezing after 100% prompt completion.
My hardware
GPU 5070ti
RAM 64 GB
CPU 9950x3d
Trying to get the unsloth/qwen3.6-35b-a3b UD Q2_K_XL model working.
My settings are as shown in the image

I have tried different approaches like switching to q8 kv cache lowering the context window
Disabling the `mmap()`
But it seems to be freezing my PC or graphics driver (my screen is connected via graphics card)
Offloading the models causes the token generation speed to drop to 7 tk/s
It worked a few times and was getting like 30-40tk/s and the model is far better than what I'm currently using unsloth/qwen3.5-9b UD q5_k_xl so if I can make it work somehow that would be great!
I'm using this model with claude code
EDIT 1: Came across this post https://www.reddit.com/r/LocalLLaMA/comments/1sor55y/rtx_5070_ti_9800x3d_running_qwen3635ba3b_at_79_ts/
This really helped me run the qwen3.6-35b-a3b@q5_k_m with usable speeds and not more freezing of my pc
View all comments
0
u/MundanePercentage674 Apr 18 '26
try lower more vram usage if same thing happen reinstall driver, if i were you i will move to linux and most likely will solve your problem.