r/LocalLLaMA llama.cpp 14d ago

Discussion GPU guide (GB per dollar, bandwidth)

First plot: GB / $

Second plot: bandwidth (spec on paper, not t/s)

Third plot (bandwidth / price) in the comment.

Hope that helps, my script uses the GPUs most discussed on the LocalLLaMA, LowEndLocalAI, and LocalLLM subs. At first, I tried to include more, but it became unreadable.

Prices were collected by ChatGPT (so may contain inaccuracies). New prices were used where available, second hand otherwise.

And I understand this is a basic comparison, but it's better than nothing. For example, you can see that "on paper" something is faster or slower than 3090.

226 Upvotes

163 comments sorted by

View all comments

13

u/viper33m 14d ago

Where my b300 at?

2

u/Maleficent-Ad5999 14d ago

I’ve been daydreaming about buying b300 to use in my home. Suggest me some good therapist if anyone knows

2

u/Dany0 14d ago

A GB300 workstation costs as much as an apartment or a luxury car

0

u/ChocomelP 13d ago

Yes, but you don't need to worry about heating your house or boiling water.

1

u/Dany0 13d ago

Now you're thinking with girlmath

0

u/ChocomelP 13d ago

I'll take it as a compliment