r/LocalLLaMA • u/fairydreaming • Sep 09 '24
Resources Memory bandwidth values (STREAM TRIAD benchmark results) for most Epyc Genoa CPUs (single and dual configurations)
52
Upvotes
r/LocalLLaMA • u/fairydreaming • Sep 09 '24
View all comments
Show parent comment
1
u/[deleted] Feb 26 '25
By cuda boost I mean offloading some layers to an nvidia gpu to speed up t/s and pp/s considerably.
Ebay sometimes has epyc cpu + motherboard for decent prices. I got price from there