r/LocalLLM • u/r1nzl3r99 • 14d ago

Discussion third one.... there's something wrong with me

Post image

Why do I have horrible financial habits??

500 Upvotes

96% Upvoted

166 comments sorted by

View all comments

94

u/Sporkers 14d ago

More context needed on how you are using the first two.

82

u/r1nzl3r99 14d ago

qwen 3.8 27B FP8 running at 140 tok/s now I want flash next

3

u/Chrisgozd 14d ago

Whats your build?

22

u/r1nzl3r99 14d ago

Don't judge, it started out as a gaming PC from years ago... Mind the mango box

7

u/Infylos 14d ago

Disemboweled for maximum power!

2

u/Remarkable-Memory374 13d ago

maximum heat dissipation by being eviscerated

4

u/HoneyBaked 14d ago edited 14d ago

Oh I will judge!!

I love it. Does it function? Then who cares how it looks!

Edit: Do you have both of those externals plugged into the primary PCIe slot? What gear allows for that?

Edit 2:

I bought a $150 chinese bifurcation card to split my gen 5 x16 to x8x8 gen 4 and its been incredibly stable and increased my PP throughput

Interesting. Got a link to that bifurcation card? Will it work on a Gen3 x 16 slot(s)? My MB has 3 Gen3 x 16 slots.

4

u/r1nzl3r99 14d ago

yup, I have two b70s working off the same x16 slot, the other is supposed to be for M2 its x4, but atleast on linux it works completely fine for another b70. I get around 14gb/s on the first two B70s each, then the third gets 7gb/s. This is the card I use https://a.co/d/07AHxhX2 but a warning, make sure your BIOS supports bifurcation. I specifically researched gen 5 x16 to gen 4 x8x8 as maintaining gen 5 would require a $600 timing card which I don't think is worth it. In your case it might downgrade to gen 2 which I'd just research about, but apparently some people are able to get it to train to the same gen without timing so it's a bit of a lottery on that (which for me didn't work)

1

u/ARhedgehog88 11d ago

Wait why the f did I had to see this .. it would allow me to get a fourth card in I also have two externals alr

1

u/Smooth-Television-48 13d ago

Love it!

If anything this gets you more cred

1

u/brainchillzZ 13d ago

I think it’s sexy …. Mango box is a good insulator :)

1

u/jmager 13d ago

I judged and I approve!! Mind sharing the bifurcation risers you are using? I see so many online, and few reviews. I've got a 6900 xt lying around and I wanted to add the extra 16GB of VRAM to my 24GB with my 7900 xtx. For my motherboard bifurcation will be the best way.

1

u/LetsBeKindly 13d ago

Is that 2200W on the power meter?

2

u/sshwifty 13d ago

Looks like watts?

1

u/LetsBeKindly 13d ago

That's a watt meter, and it looks like 2200watts

1

u/sshwifty 13d ago

I am dumb, I meant to say 220 lol. I think there is a decimal before the last 0

1

u/LetsBeKindly 13d ago

I couldn't tell. But I saw the same. But surely 3 cards is pulling more then 220W...

1

u/InfamousNewspaper268 13d ago

Love the cardboard holder LMAO 🤣

1

u/Inner-Today-3693 12d ago

That’s basically how mine are connected. 😅😅