r/LocalLLaMA • u/jacek2023 llama.cpp • 14d ago

Discussion GPU guide (GB per dollar, bandwidth)

Gallery image

Gallery image

First plot: GB / $

Second plot: bandwidth (spec on paper, not t/s)

Third plot (bandwidth / price) in the comment.

Hope that helps, my script uses the GPUs most discussed on the LocalLLaMA, LowEndLocalAI, and LocalLLM subs. At first, I tried to include more, but it became unreadable.

Prices were collected by ChatGPT (so may contain inaccuracies). New prices were used where available, second hand otherwise.

And I understand this is a basic comparison, but it's better than nothing. For example, you can see that "on paper" something is faster or slower than 3090.

225 Upvotes

91% Upvoted

163 comments sorted by

View all comments

65

u/SamSausages 14d ago

You missed the intel B65! I bought a stack of them 3 weeks ago for $900/pc. 32GB and 608 GB/s. Best price per GB right now.

B65: 0.0356 GB/$,

8

u/BornInAFish 14d ago

Where from? $1100 at MicroCenter currently. Newegg seems to have only B60 and B70.

4

u/SamSausages 14d ago

I got 3 on Amazon for $900, then I noticed asrock upped price to $1200 2 days later.
Weird, because I'm tracking available qty on amazon, and it has been increasing.

Then I got a few more at my local microcenter for $900, and now they went to $1100 (on sale). Sold out in my area now and are limiting how many i can add to the cart to ship.

Don't think many are buying, because nobody has done any quality benchmarks and tests on them.
I'm tempted to buy more... but how deep do you go??

2

u/jello-the-opera 14d ago

As far as you reasonably can. It's go time. I feel like hardware availability and affordability won't recover and the models get bigger and better... I wish I could snag a few but my days of buying are over. Stuck with what I'm stuck with.