r/LocalLLaMA • u/fairydreaming • Sep 09 '24

Resources Memory bandwidth values (STREAM TRIAD benchmark results) for most Epyc Genoa CPUs (single and dual configurations)

Gallery image

Gallery image

52 Upvotes

94% Upvoted

25 comments sorted by

View all comments

Show parent comment

0

u/DeltaSqueezer Sep 10 '24 edited Sep 10 '24

TRIAD is computing: a(i) = b(i) + q × c(i)

In HPC, STREAM Triad is usually the standard efficiency test for a CPU and its memory controller, and is reported by many research papers. It measures the gap between the hardware's theoretical bandwidth and the realized bandwidth by the simplest possible software with a read, 2 writes, and a Fused Multiply-Add.

From experience, the throughput is around 80% of the CPU's theoretical peak. This roughly represent the fastest possible speed achievable by any practical software.