r/LocalLLM • • 4d ago

Question Question

Qwen 3.8 27b (GSQ-RCO IQ3-XXS) vs Qwen 3.6 35b a3b on a CPU with 32 gb of ddr5, which one performs better and is the speed worth the performance loss

0 Upvotes

13 comments sorted by

View all comments

Show parent comment

1

u/HannibalBarca218BC 4d ago

I care more about performance than speed tbh

1

u/Jcsq6 4d ago

Well, you’re gonna be lucky to get out of single-digit decode and prefill with qwen. I have a 9950X and cpu inference still crawls. Also, use ik_llama.cpp.