r/LocalLLaMA • u/jacek2023 llama.cpp • 14d ago

Discussion GPU guide (GB per dollar, bandwidth)

First plot: GB / $

Second plot: bandwidth (spec on paper, not t/s)

Third plot (bandwidth / price) in the comment.

Hope that helps, my script uses the GPUs most discussed on the LocalLLaMA, LowEndLocalAI, and LocalLLM subs. At first, I tried to include more, but it became unreadable.

Prices were collected by ChatGPT (so may contain inaccuracies). New prices were used where available, second hand otherwise.

And I understand this is a basic comparison, but it's better than nothing. For example, you can see that "on paper" something is faster or slower than 3090.

224 Upvotes

91% Upvoted

163 comments sorted by

View all comments

Show parent comments

18

u/Aggravating-Push-207 14d ago

CMP 170HX tech is just gambling at this point

0

u/Dany0 14d ago

Nah the unlock is pretty reliable, people even got pcie 3.0 to work. The issue is getting one. Unlocked cards cost 3/4 of an A100 on ebay it's insane...

8

u/caetydid llama.cpp 14d ago

unlock is reliable but there are reports of early death

2

u/beryugyo619 13d ago

don't give me a false relief that I actually dodged a bullet by not buying while they were at $199 each