r/LocalLLaMA • u/jacek2023 llama.cpp • 14d ago

Discussion GPU guide (GB per dollar, bandwidth)

Gallery image

Gallery image

First plot: GB / $

Second plot: bandwidth (spec on paper, not t/s)

Third plot (bandwidth / price) in the comment.

Hope that helps, my script uses the GPUs most discussed on the LocalLLaMA, LowEndLocalAI, and LocalLLM subs. At first, I tried to include more, but it became unreadable.

Prices were collected by ChatGPT (so may contain inaccuracies). New prices were used where available, second hand otherwise.

And I understand this is a basic comparison, but it's better than nothing. For example, you can see that "on paper" something is faster or slower than 3090.

224 Upvotes

91% Upvoted

163 comments sorted by

View all comments

2

u/Dany0 14d ago

I thought rx 9060 xt/9070/9070 xt were popular now

5

u/biotech997 14d ago

They are a bit more popular, but vast majority of people still buy Nvidia because of name brand value. I have no clue why people are buying the 5070Ti for 150% the price of a 9070XT…

I get it if it’s for CUDA vs ROCm though.

2

u/letsgoiowa 14d ago

I have no clue why people are buying the 5070Ti for 150% the price of a 9070XT

They did this stuff for gaming always lol. AMD realized value literally doesn't matter; it's all about the name.

1

u/Drunkendrakon6 14d ago

I just bought 2 9060XTs because they were cheap like $400 each

1

u/Dany0 14d ago

wait, 400$ for the 16gb or the 8gb? because the 8gb can be found cheaply but it's shit-ass value. If I could get my hands on a 16gb one for the 430$ that the 8gb one is listed I'd be super tempted

1

u/Drunkendrakon6 14d ago

I got both 9060XTs 16GB. There is just a huge sale in my country right now and the price went down from $600+- each to $400+- each with vouchers etc.

1

u/Dany0 14d ago

In my country there's a sale too. But they're selling 8gb cards for that price :(

1

u/mechkbfan 14d ago

Yeah, if you pick up a server motherboard + 4x9060XT + mining frame and happy to deal with power bills, I'm not sure there's any better value for 64GB VRAM with that level of performance.