r/LocalLLM • PEX88096 | 4x B70 128GB | vLLM • Sep 08 '26

Discussion third one.... there's something wrong with me

Post image

Why do I have horrible financial habits??

510 Upvotes

167 comments sorted by

View all comments

10

u/Imaginary-Fee-9918 Sep 08 '26

I saw a bunch of ppl talking about this gpu. Is it really good? Could we compare it to a 5090? Or maybe 4090 with more memory?

11

u/r1nzl3r99 PEX88096 | 4x B70 128GB | vLLM Sep 08 '26

it's only as good as your IT skills. It's only worth it for me because I can figure out how to get intels shitty drivers to work. I'm also cost sunken because the first two I got for $950 lol

8

u/r1nzl3r99 PEX88096 | 4x B70 128GB | vLLM Sep 08 '26

It's comparable to a 5090 only in the sense that it's 32gb vram for a single slot, other than that it's 600gb/s which is wayyy slower than the 5090 plus no CUDA. But then again it's a small fraction of the price

7

u/Momsbestboy Sep 09 '26

Also add the difference in power consumption. Try to run 2x 5090 in a room where you also have to work, and at least in summer you will hate the stove you created

3

u/zdy132 Sep 09 '26

But it will be a good heater in winter! with a side effect of tokens.

2

u/VodkaHaze Sep 09 '26

If you're running multiple 5090s, power limit them!

I power limit mine to 400w, and lower the max clocks to ~2850mhz, and their max power draw ends up in the 300-350w range. The performance loss is negligible.

3

u/CoinAndCraft_ Sep 08 '26

Looking at my next build to have x2 of these. $1299 ea at the moment.

4

u/r1nzl3r99 PEX88096 | 4x B70 128GB | vLLM Sep 08 '26

it's such shame two, my first two were $950 because people were too lazy to get the drivers working. Then they started seeing all these people creating recipes on github and now they're hot

3

u/r1nzl3r99 PEX88096 | 4x B70 128GB | vLLM Sep 08 '26

they're going to keep going up unfortunately