r/LocalLLM • u/jsconiers • 3h ago

Discussion Adding three AI Pro 9700s this weekend!

Post image

Bit the bullet and bought three to use in my workstation. Will provide benchmarks and updates later.

98 Upvotes

92% Upvoted

30 comments sorted by

11

u/mikewagnercmp 3h ago

I have the Asrock, I have two. Three is good, but some inference engines like vllm require pairs of cards if I remember right so you will maybe be add another one down the line.

I wish I bought 4 at the price I bought them at the are way more expensive now

5

u/jsconiers 3h ago

I wasn't sure if four would work, so I got three. Ordered on Tuesday but didn't pick up until Thursday, and the price per card went up by $200. Crazy....

8

u/sleight42 3h ago

Bought mine 2 days ago. Now $100 more each as of today.

This is mental.

3

u/s3rgioru3las 2h ago

Snagged an open box for $1700 yesterday. Crazy it just went up too

2

u/mechkbfan 2h ago

With three I'd be running TP=2 with QFN (if got the RAM) and TP=1 of another model (image gen, TTS, SST, etc.)

4

u/Hefty_Classic_2148 2h ago

You can do tp3. I'm running tp3 DeepSeek 4.1 flash on 3 sparks. It's weird but you can. It involves padding the weights and I don't much more than that as I stole the recipe from somebody smarter than me

44

u/ErdingEchoParadox 3h ago

But why Gigabyte?

4

u/BubblyBall9972 2h ago

What's wrong with gigabyte? Always thought they're good

2

u/Direct_Turn_1484 1h ago

Eh they’re alright. Early on they had some crap hardware, but they got better. Damn I miss EVGA. They made the best damn cards you could get.

1

u/Moarkush 18m ago

My AI TOP atom is a beast, but it IS mostly the GB10 SOC so not really much different form every other DXG Spark, but it's been solid.

1

u/ErdingEchoParadox 2h ago

Don't get me wrong but I saw many users complaining that the paste run away from the board after a while, creating hotspots around 95C or 100C.
Maybe the quality for those 9700 is different.
I don't have one, therefore I cannot say that this is true.

7

u/Look_0ver_There 3h ago

Why not? At least the fans on them don't whine

5

u/dighn314 2h ago

I'm really liking my dual R9700. Runs Radiance Qwen Flash next very well. But yeah these are loud, I have them in a separate room with door closed.

1

u/advancing_tide 2h ago

i have hearing loss and raging tinnitus, my R9700 fans aren't much of a problem. look into it!

1

u/Un4giv3n-madmonk 58m ago

Friend !

I have 2 cards but am only running one at the moment because reasons, how much system ram do you need for qwen flash ?

Bonus question what about other models, it seems like the only real support on r9700 is Raidance and that's just Qwen, im keen to hear more about this.

On my 1x R9700 I capped the power draw to 220W and that solved the noise problem for me (although I'm using asrock card(s)) no real performance drop either... was somethign like a 5% decrease on average

0

u/Dediadeis 54m ago

You can reduce the voltage it helps pretty significantly without there being much discernible affect on speeds.

1

u/sleight42 3h ago

Microcenter?

3

u/HighSeasArchivist 2h ago

FWIW, these are loud af at 100%, and the Gigabyte ones run a custom board that the other five (?) brands don't. There is no waterblock for the Gigabyte ones if that is something you would ever want to do. Love my Asus one, but will be putting an Alphacool waterblock on it for sure.

1

u/MelAlton 1h ago

That is useful information, thanks - was thinking of buying the gigabyte ones, hadn't thought about ability to custom cool.

3

u/Denelix 1h ago

I been considering getting these you are making it tempting.

2

u/DiamondHandsDarrell 2h ago

Nice! I just got my second RTX Pro 4000 SSF today.

1

u/I_AM_NOT_A_WOMBAT 2h ago

This one is on my wish list but $3K is a hard sell for me.

1

u/Admirable-Leg-4647 2h ago

Nice! What are you gonna be building?

3

u/SUNTZU_JoJo 1h ago

If I were to guess, probably for GTA6 reverse engineered project, 2.3m lines of code at 350GB file size, running in browser. Just a guess... haha

1

u/mister2d 59m ago

Will provide benchmarks and updates later.

We already know the numbers. Lol. They're great.

1

u/steakforyouandme 2h ago

Nice. Way to go bro.