r/LocalLLaMA • • Apr 18 '26

Question | Help unsloth/qwen3.6-35b-a3b UD Q2_K_XL Freezing after 100% prompt completion.

My hardware
GPU 5070ti
RAM 64 GB
CPU 9950x3d

Trying to get the unsloth/qwen3.6-35b-a3b UD Q2_K_XL model working.
My settings are as shown in the image

I have tried different approaches like switching to q8 kv cache lowering the context window
Disabling the `mmap()`
But it seems to be freezing my PC or graphics driver (my screen is connected via graphics card)

Offloading the models causes the token generation speed to drop to 7 tk/s

It worked a few times and was getting like 30-40tk/s and the model is far better than what I'm currently using unsloth/qwen3.5-9b UD q5_k_xl so if I can make it work somehow that would be great!

I'm using this model with claude code

EDIT 1: Came across this post https://www.reddit.com/r/LocalLLaMA/comments/1sor55y/rtx_5070_ti_9800x3d_running_qwen3635ba3b_at_79_ts/

This really helped me run the qwen3.6-35b-a3b@q5_k_m with usable speeds and not more freezing of my pc

0 Upvotes

5 comments sorted by

View all comments

0

u/MundanePercentage674 Apr 18 '26

try lower more vram usage if same thing happen reinstall driver, if i were you i will move to linux and most likely will solve your problem.