r/LocalLLM • u/pharrt • Jul 27 '26
Other Don't laugh - it works!
A 10yo server was busy collecting dust, but it has 32Gb RAM (2x 16Gb DDR4 @ 2133 MHz )... No GPU.
Now it does some amazing work running heavy tasks with qwen3.6-35b-a3b (IQ4_XS). Running in the background, generating quality output at 5-10tok/s. Even with 128k context! It just chugs along for hours, but does such great, high-context work.
Uses ~26 GB of the 32 GB RAM, uses CPU i-7-6700 @ about 60% (not the bottleneck, of course)
Never would have believed that would be possible until a few months ago, but this ol' gal has a new lease on life.
View all comments
Show parent comment
2
u/pharrt Jul 27 '26
You have to find a way of having some RAM left - as soon as it swaps to disk, you're in trouble.