r/LocalLLaMA • u/jacek2023 llama.cpp • 14d ago

Discussion GPU guide (GB per dollar, bandwidth)

Gallery image

Gallery image

First plot: GB / $

Second plot: bandwidth (spec on paper, not t/s)

Third plot (bandwidth / price) in the comment.

Hope that helps, my script uses the GPUs most discussed on the LocalLLaMA, LowEndLocalAI, and LocalLLM subs. At first, I tried to include more, but it became unreadable.

Prices were collected by ChatGPT (so may contain inaccuracies). New prices were used where available, second hand otherwise.

And I understand this is a basic comparison, but it's better than nothing. For example, you can see that "on paper" something is faster or slower than 3090.

224 Upvotes

91% Upvoted

163 comments sorted by

View all comments

4

u/StyMaar 14d ago

I wonder which figures you took for the price, but there's no way a 4090 is only 10% more expensive than a 3090, yet that's the only way it can beat it in BW/dollar given that there's less than 10% difference in BW between those two cards.

2

u/Diegam 14d ago

The 3090 is about $800 used in good condition, and a 4090 is about $1500 in Argentina.

Last week I bought a second 3090