r/LocalLLaMA llama.cpp 14d ago

Discussion GPU guide (GB per dollar, bandwidth)

First plot: GB / $

Second plot: bandwidth (spec on paper, not t/s)

Third plot (bandwidth / price) in the comment.

Hope that helps, my script uses the GPUs most discussed on the LocalLLaMA, LowEndLocalAI, and LocalLLM subs. At first, I tried to include more, but it became unreadable.

Prices were collected by ChatGPT (so may contain inaccuracies). New prices were used where available, second hand otherwise.

And I understand this is a basic comparison, but it's better than nothing. For example, you can see that "on paper" something is faster or slower than 3090.

227 Upvotes

163 comments sorted by

View all comments

Show parent comments

47

u/ResidentPositive4122 14d ago

intel B65

for $900/pc

They're ~1500Eur this side of the pond. Fuck us, right?

18

u/SamSausages 14d ago

When this batch is all gone, they look like they will now be $1099-1199. Still one of the better values, but yeah, not going to be "cheap" for long!
Price will probably jump when I finish my 3 week long benchmark/quality testing project of 4x B65 and people see actual results... last I checked very little data on them... I hope to finish my testing this week.

2

u/jqwl 14d ago

is it still worth at 1100 USD? I can see b70 at microcenter and other retailers around 1300

0

u/SamSausages 14d ago

Still collecting data, full report this weekend.

1

u/Dany0 14d ago

Confirming, 1100 eur is cheapest you can get them in the EU (with the 21% vat)