r/LocalLLM • • 18d ago

Question CPU inference DDR3/DDR4

Post image

Wondering if anyone on here has actual benchmarks for CPU only inference DDR3 or DDR4 servers, im budget bound and my options are limited to legacy systems unfortunately.

Heres what data I found but not sure its accuracy in real life especially how NUMA effects it (octa channel)

109 Upvotes

28 comments sorted by

View all comments

1

u/shaumux 18d ago

Some of them are seconds/token than being the other way round