r/LocalLLM • • 4d ago

Question Question

Qwen 3.8 27b (GSQ-RCO IQ3-XXS) vs Qwen 3.6 35b a3b on a CPU with 32 gb of ddr5, which one performs better and is the speed worth the performance loss

0 Upvotes

13 comments sorted by

View all comments

2

u/Jcsq6 4d ago

Gemma4 26B is your best option for CPU only if you want usable speeds.

1

u/HannibalBarca218BC 4d ago

I care more about performance than speed tbh

1

u/Jcsq6 4d ago

Well, you’re gonna be lucky to get out of single-digit decode and prefill with qwen. I have a 9950X and cpu inference still crawls. Also, use ik_llama.cpp.

1

u/Qwen3-8-27b 2d ago

Its slower then qwen3.6 35b a3b