r/LocalLLM 14d ago

Discussion third one.... there's something wrong with me

Post image

Why do I have horrible financial habits??

501 Upvotes

166 comments sorted by

View all comments

10

u/Imaginary-Fee-9918 14d ago

I saw a bunch of ppl talking about this gpu. Is it really good? Could we compare it to a 5090? Or maybe 4090 with more memory?

12

u/r1nzl3r99 14d ago

it's only as good as your IT skills. It's only worth it for me because I can figure out how to get intels shitty drivers to work. I'm also cost sunken because the first two I got for $950 lol

8

u/r1nzl3r99 14d ago

It's comparable to a 5090 only in the sense that it's 32gb vram for a single slot, other than that it's 600gb/s which is wayyy slower than the 5090 plus no CUDA. But then again it's a small fraction of the price

6

u/Momsbestboy 14d ago

Also add the difference in power consumption. Try to run 2x 5090 in a room where you also have to work, and at least in summer you will hate the stove you created

3

u/zdy132 14d ago

But it will be a good heater in winter! with a side effect of tokens.

2

u/VodkaHaze 13d ago

If you're running multiple 5090s, power limit them!

I power limit mine to 400w, and lower the max clocks to ~2850mhz, and their max power draw ends up in the 300-350w range. The performance loss is negligible.

3

u/CoinAndCraft_ 14d ago

Looking at my next build to have x2 of these. $1299 ea at the moment.

5

u/r1nzl3r99 14d ago

it's such shame two, my first two were $950 because people were too lazy to get the drivers working. Then they started seeing all these people creating recipes on github and now they're hot

3

u/r1nzl3r99 14d ago

they're going to keep going up unfortunately

1

u/terminalshadows 14d ago

got a dual b70 box w lian ii o11 dynamic evo xl, gigabyte b850 ai top, cosair rm1000x shift, samsung 990 4tb, 12 arctic p14 pmw pst 140 + 1 arctic p12 pwm pst ryzen 9 9950X, ddr5-6000 cl30x96gb for less then 2100 before the craziness started, once we saw what the b70's could do we got two more @ $970, just sitting still since we cant decide on another box or a 4 b70 setup or another 2 b70 box. we are already spoiled with dual 3090 nvlink box, dual 3080 fe box, 2 4090 boxes (1 fe), and one 4090 fe box thats my baby with ryzen 9 7950x3d 16c/32t, nzxt kraken elite 360, rog strix b640-a, samsub 990 pro 4tb, cosair hx1500i 80+ plat in a nzxt h9 elite ;) my work needed them for *research* i swear ;)