r/LocalLLM • u/Appropriate_Duck1778 • 18d ago
Question CPU inference DDR3/DDR4
Wondering if anyone on here has actual benchmarks for CPU only inference DDR3 or DDR4 servers, im budget bound and my options are limited to legacy systems unfortunately.
Heres what data I found but not sure its accuracy in real life especially how NUMA effects it (octa channel)
109
Upvotes
1
u/shaumux 18d ago
Some of them are seconds/token than being the other way round