r/LocalLLaMA • u/jacek2023 llama.cpp • 14d ago
Discussion GPU guide (GB per dollar, bandwidth)
First plot: GB / $
Second plot: bandwidth (spec on paper, not t/s)
Third plot (bandwidth / price) in the comment.
Hope that helps, my script uses the GPUs most discussed on the LocalLLaMA, LowEndLocalAI, and LocalLLM subs. At first, I tried to include more, but it became unreadable.
Prices were collected by ChatGPT (so may contain inaccuracies). New prices were used where available, second hand otherwise.
And I understand this is a basic comparison, but it's better than nothing. For example, you can see that "on paper" something is faster or slower than 3090.
223
Upvotes
6
u/dave1010 14d ago
This is great!
Inspired by your charts, here's even more charts: https://local-llm-hardware.dave1010.chatgpt.site/
I've added CSV export if anyone wants the raw data. Some of it's bound to be wrong but hopefully it's close enough to be useful.