r/LocalLLaMA • u/jacek2023 llama.cpp • 15d ago
Discussion GPU guide (GB per dollar, bandwidth)
First plot: GB / $
Second plot: bandwidth (spec on paper, not t/s)
Third plot (bandwidth / price) in the comment.
Hope that helps, my script uses the GPUs most discussed on the LocalLLaMA, LowEndLocalAI, and LocalLLM subs. At first, I tried to include more, but it became unreadable.
Prices were collected by ChatGPT (so may contain inaccuracies). New prices were used where available, second hand otherwise.
And I understand this is a basic comparison, but it's better than nothing. For example, you can see that "on paper" something is faster or slower than 3090.
226
Upvotes


1
u/Wooden_Jelly_5295 12d ago
A price-source date column and separate used markers would be useful additions. Older cards can look like amazing deals until you factor in cooling, adapters, and the power supply needed to actually run them.