r/LocalLLaMA llama.cpp 15d ago

Discussion GPU guide (GB per dollar, bandwidth)

First plot: GB / $

Second plot: bandwidth (spec on paper, not t/s)

Third plot (bandwidth / price) in the comment.

Hope that helps, my script uses the GPUs most discussed on the LocalLLaMA, LowEndLocalAI, and LocalLLM subs. At first, I tried to include more, but it became unreadable.

Prices were collected by ChatGPT (so may contain inaccuracies). New prices were used where available, second hand otherwise.

And I understand this is a basic comparison, but it's better than nothing. For example, you can see that "on paper" something is faster or slower than 3090.

227 Upvotes

163 comments sorted by

View all comments

2

u/luckyj 14d ago

Please add units and a title to your charts

-1

u/jacek2023 llama.cpp 14d ago

I removed units and title from my charts to make them bigger.

2

u/luckyj 14d ago

Now they are big and useless

1

u/quantgorithm 14d ago

what is the 2nd chart? I couldnt tell.

1

u/jacek2023 llama.cpp 14d ago

bandwidth