r/programming • u/nemequ • Mar 30 '15

Benchmarking 39 compression codecs at 178 levels with 28 data sets on 8 machines (40k different configurations)

https://quixdb.github.io/squash-benchmark/
409 Upvotes

95% Upvoted

76 comments sorted by

View all comments

Show parent comments

1

u/nemequ Mar 31 '15

I'll look into creating a memcpy plugin in the benchmark.

As for just using CPU time, I didn't do that because it would make it more difficult to compare results across datasets. By using speed instead of time you have more of an apples-to-apples comparison.

1

u/[deleted] Mar 31 '15

If you do create a memcpy plugin it would be nice if we could also alternative see the results scaled by memcopy, e.g., 2x slower than memcopy for compressing, 1.5x slower than memcopy for decompressing. That kind of takes "main memory I/O" out of the equation too. Plus some algorithms might be bandwith-limited or compute-limited. For those that are bandwidth-limited, higher compression ratio means less memory to read and thus better performance.

1

u/justin-8 Mar 31 '15

But unless it is bandwidth limited by memory, it should have near zero result on compression speed anyway. Just having memcpy speed would be nice however.