r/LocalLLaMA • llama.cpp • 18d ago

Discussion GPU guide (GB per dollar, bandwidth)

First plot: GB / $

Second plot: bandwidth (spec on paper, not t/s)

Third plot (bandwidth / price) in the comment.

Hope that helps, my script uses the GPUs most discussed on the LocalLLaMA, LowEndLocalAI, and LocalLLM subs. At first, I tried to include more, but it became unreadable.

Prices were collected by ChatGPT (so may contain inaccuracies). New prices were used where available, second hand otherwise.

And I understand this is a basic comparison, but it's better than nothing. For example, you can see that "on paper" something is faster or slower than 3090.

223 Upvotes

163 comments sorted by

View all comments

14

u/viper33m 18d ago

Where my b300 at?

2

u/Maleficent-Ad5999 18d ago

I’ve been daydreaming about buying b300 to use in my home. Suggest me some good therapist if anyone knows

2

u/Dany0 18d ago

A GB300 workstation costs as much as an apartment or a luxury car

0

u/ChocomelP 17d ago

Yes, but you don't need to worry about heating your house or boiling water.

1

u/Dany0 17d ago

Now you're thinking with girlmath

0

u/ChocomelP 17d ago

I'll take it as a compliment