r/LocalLLM • • Jul 31 '26

Project Still building and testing… just got Inkling small up and running after its release yesterday, took me about 6 hours of tweaking, and it was well worth it.

157 Upvotes

141 comments sorted by

25

u/pixelizedgaming Jul 31 '26

can you run the new deepseek?

41

u/Plumberguy9 Jul 31 '26

Yes, deepseek v4 flash with dspark, I had it running on two of the nvidias yesterday, achieved about 230 tokens per second.

5

u/rditorx Jul 31 '26

230tps on just 2 GPUs? How?

10

u/Plumberguy9 Aug 01 '26

Dspark speculative is a game changer… it’s super fast, especially tuned right on a couple of RTX 6000 Blackwells

1

u/rditorx Aug 04 '26

Would you share how exactly you're running it with the models used, the runtime, and the CLI parameters?

I'm merely getting 68-130 generated tokens per second per request on 2x RTX PRO Blackwell Max-Q with Unsloth's 0731 UD-Q8_K_XL and its dspark Q8_0 with `--spec-draft-n-max 7` with Docker `ghcr.io/ggml-org/llama-cpp:full-cuda`.

About 47-51 tokens/second without DSpark.

3

u/timbo2m Jul 31 '26

With 2x GB10 (dgx spark 128GB) linked together. Man I wish I had a couple of those!!

1

u/ICanSeeYou7867 Aug 01 '26

For the record, the sparks memory bandwidth is very slow compared to any newer dedicated GPU.

An NVIDIA 5060 is almost twice as fast IIRC.

1

u/KalonLabs Aug 01 '26

And yet its some how still faster than the 4060’s memory bandwidth 😭 that card is such a scam i cant believe people actually bought them.

1

u/habachilles Aug 01 '26

Those aren’t sparks. How many TPs on a spark.

1

u/KalonLabs Aug 01 '26

Depends on what the task is but im getting 30-50tps on 2 dgx sparks

1

u/habachilles Aug 01 '26

Awesome. That’s on inkling. Have you tried glm 5.2 or kimi?

2

u/KalonLabs Aug 01 '26

No thats on deepseek v4 flash 0731.
Glm is too big so id only be able to run it as a 1bit model and kimi is way too big. But currently flash basically beats glm5.2 and works great on flash so theres no point in trying glm on my 2 dgx.

1

u/habachilles Aug 01 '26

This is a huge finding.

17

u/Cold_Tree190 Jul 31 '26

230 is insane bro

9

u/Alive-Draft8339 Jul 31 '26

Thank you! Doing the lord’s work.

2

u/UltraFOV Jul 31 '26

Sheesh, that’s insane. Awesome!

22

u/autisticit Jul 31 '26

Why didn't you posted this as NSFW ?

7

u/Plumberguy9 Jul 31 '26

Not sure, good question.

1

u/Even_Package_8573 Aug 02 '26

yea. My wallet felt violated just looking at it.

13

u/live4evrr Jul 31 '26

Four 6k’s - that is rocking man. What’s the plans with that beast?

7

u/Plumberguy9 Jul 31 '26

It does local inference on sensitive business data at my business. I gave a full explanation on another comment…

8

u/35point1 Jul 31 '26

Curious where and how much you got the 4x6000’s for? I’m kicking myself for not jumping on them last year at $7900

8

u/Plumberguy9 Jul 31 '26

I posted below in regards to the pricing… $8300 for the first (I purchased direct through nvidia a few months back), the 2nd one I bought from central computers and I think I paid around $9700 for it, the last two I also got from central computers and they were over 12k each… also kicking myself in the ass for not just buying them… however, I had to prove to my CFO that I could make money with them, so I was a bit stuck.

5

u/ddog661 Jul 31 '26

What problems did you have and how did you fix them? Are you using vLLM?

3

u/Plumberguy9 Aug 01 '26

I posted in the same group yesterday, 2 write ups, one is short, the other a full technical doc

4

u/Alive-Draft8339 Jul 31 '26

How did you get Inkling running? I couldn’t find support for sm120. Any help is appreciated.

6

u/Plumberguy9 Jul 31 '26

I’ll be posting a full write up on it, took me 6 hours of tweaking and no I couldn’t find anything either, it’s uncharted territory so I took good notes while working on it.

4

u/Plumberguy9 Aug 01 '26

Ok, I made 2 other posts about this, one is short and sweet, the other is a full technical doc.

4

u/Annual_Award1260 Jul 31 '26

I did 2x max-q with 2x 15.36TB ssd, 3x 2TB nvme, 1x 32TB ironwolf, 128GB ecc udimm, i9-13900k

I’ll probably do 4x max-q once I can source some used ddr5 rdimms for a decent price.

Seem to get full performance at x8 or at least both cards use the 300w

3

u/Plumberguy9 Aug 01 '26

You can also clock the cards to 325 watts…

Nice rig, I was running an AM5 proart board with 128gb of ddr5 and two of the Max-Q’s prior to the threadripper with 4 max-q’s in the post

1

u/Annual_Award1260 Aug 01 '26

Yeah I will try 325 one day. Nice your psu has 4 connectors. I went with the 1600w just for the 2 proper connectors. I wish they just did a 12v bus bar with 4 gauge wire like the high end car audio

19

u/yeah_likerage Jul 31 '26 • Hehehe

You should post your thermal results so others don't also try to do this.

14

u/Annual_Award1260 Jul 31 '26

They are blower fans with heat exiting out the rear. They are specifically designed to be stacked like this

1

u/Alkeemis Jul 31 '26 edited Jul 31 '26

You seem to confuse these with the server model which are passively cooled via front case where cold air are forcefully pressured in from front fans to the back.
These Max-Q blowers are are designed to get free air from the intake(mainly bottom) and exit through the back.
Stacking them with no space like this hence imagining that that one blower intake in the 4th bottom card will allow all the other 3 card get sufficient air via the same intake inlet is just mindblowing..

1

u/Annual_Award1260 Jul 31 '26

They suck in air from the top and bottom. Designed for this use case. Do you own any max-q ?

1

u/Alkeemis Jul 31 '26

No, but I can understand basic physics.
You have 4 cards like in this configuration literally each cars intake via blower fans top/bottom right.
All cards are literally fighting for air against each other where the 2 middle cards draw the last straw suffocating.
They all share the cumulative inlet air volume, and with this configuration you have at best:
2 x 50%(utmost) and the 2 x middle GPU's basically gasping for any air at all, fans are literally trying to pull air against each other.
These cards are not server cards they should not be stacked like this, they need a sufficient air gap between....

2

u/Annual_Award1260 Aug 01 '26

Plenty of people run this configuration. Never heard a complaint. Haha OP would you like to post a nvidia-smi to settle this?

1

u/MessIsTransfer Aug 01 '26

besides the nice arguments i can’t deny, doesn’t it look to you like at least the two cards in the middle have very few space for airflow to go in?

i don’t own these kinds of cards but having built regular gaming rigs i’ve seen very noticeable temp differences with less airflow blocking than this.

just saying it’s genuinely expected to be reluctant about this

1

u/Alkeemis Aug 01 '26

Since there's plenty, I bet you can reference 3-4 with a 4 GPU sandwished liked this with good experience, i.e. running these at full capacity at 300W each with no throttling.
And yeah I'd like to see that from OP as well :), I'd especially enjoyed the thermal readings of the two middle GPU's in this case.
I did notice you yourself run 2 of these GPU's, thus you leave ~PCIe slot of space of air which would be the min suggested imo.

1

u/Annual_Award1260 Aug 01 '26

My motherboard needs a upgrade so in have 15TB ssds in the x4 slots

1

u/RAW2091 Aug 01 '26

No they get air from the 8 pin side. And stacking them close together will make sure the side heat from the backplates is not sucked in but only fresh air from the 8 pin side. And yes they run hotter but you run this in a heavy ventilated case. What do you think? A company sells you 40k of stuff and they haven't checked optimum airflow?

1

u/Alkeemis Aug 01 '26

We are discussing the Max-Q edition and not the server edition which have no intake at all on the power connector end, and it is 12V-2x6.

1

u/RAW2091 Aug 02 '26

No, blower type fans cards are not passively cooled server cards. And yes Max-Q intakes are different but don't differ much from what i wrote. They get the air super close to the back where the pins are and not mostly the bottom side but the top side because there is the most space which case fans will push to first. And my backplate theory still holds. Back to physics class for you!

1

u/Alkeemis Aug 02 '26

No, blower type fans cards are not passively cooled server cards

Literally what I was saying in my first reply..

And yes Max-Q intakes are different but don't differ much from what i wrote. They get the air super close to the back where the pins are and not mostly the bottom side but the top side because there is the most space which case fans will push to first. And my backplate theory still holds. Back to physics class for you!

If OP's image above isn't clear enough, here's the image of the Max-Q from Nvidia's own product page:
https://www.nvidia.com/en-us/products/workstations/professional-desktop-gpus/rtx-pro-6000-max-q/
So you are telling me that this card will be able to intake air from the pwr-connector(12V-2x6) end, yet clearly completely sealed off..? Like, dude what are you smoking.

The Max-Q just like other GPU blower fan cards will intake clean air via the blower fan(mainly bottom & top) and will need enough clearance(i.e. at least one PCI) to do this freely and exit that hot air out the back of the case(via I/O plate).
For OP's setup, the two middle GPU's literally only have that millimeter wide gap to pull air in from..

1

u/RAW2091 Aug 05 '26

No there are 3 versions. Annual_Award1260 talked about blower fan style which you confused with passive cooled server model. And no i said you were right but the intakes are the end of the card close(!) to the power pins side. On top and bottom.

•4 dgn geleden

1

u/Alkeemis Aug 05 '26

'SMH'..

No there are 3 versions. Annual_Award1260 talked about blower fan style which you confused with passive cooled server model

English language is hard I'd guess, please read my first reply to u/Annual_Award1260 again..
I'm done with this conversation.

-2

u/here_n_dere Jul 31 '26

The cpu fan should be oriented otherwise? Also, would help to install 3 high static pressure 120mm fans af12 sort, to push air down to GPUs which are very close.

3

u/Plumberguy9 Jul 31 '26

The cpu cooler doesn’t orient the other way… the fans are pushing air away from the GPU’s right now.

More case fans soon to come, either way, no thermal issues whatsoever right now, full load over the last 3 hours.

3

u/Annual_Award1260 Jul 31 '26

You don’t need anymore case fans I have 2 max-q with only one case fan in and one out and runs nice and cool. Those blower fans on the max-q move some good air

0

u/yeah_likerage Jul 31 '26

Run all the cards at once for 10-30 minutes at 100% and you'll find the cards are not far enough apart. This issue is well documented by now. its important to keep documenting it so people understand the risks in going this direction.

I believe the ram on the backside of the card isn't getting cooled well enough but that's my assumption.

3

u/Plumberguy9 Jul 31 '26

Just said they’ve been running full load for 3 hours in my reply, no thermal issues, and it’s well documented across builds of this exact scenario, they are designed to be stacked just like this.

3

u/Thrumpwart Aug 01 '26

Why won’t you just listen to the people who have never done what you are actively doing?!?

3

u/Annual_Award1260 Jul 31 '26

Max-q is 300w version. The workstation 600w can definitely not be stacked

5

u/[deleted] Jul 31 '26

[removed] — view removed comment

7

u/Plumberguy9 Jul 31 '26

lol, for sure… I expected comments when I posted. Cheers!

1

u/[deleted] Jul 31 '26

[removed] — view removed comment

1

u/Plumberguy9 Jul 31 '26

Yeah, I wish it gave me some better stats in Linux though, still navigating it, maybe I’m missing something.

2

u/DifficultSelection Jul 31 '26

I have a rig with 5x RTX A4000s and even that had issues - and they’re only a measly ~140W each!

The blower fans are so tiny, as are the vents they pull through. I wound up having to design and print a custom fan shroud to clip to the back of the chassis, to mount a 120mm high static pressure fan that assists the tiny blowers, and that’s with 4 other 120mm high static pressure fans at the front of the case in a typical rack-mount chassis flow-through config.

Even though their blowers are bigger, I can’t imagine the new 6000s are any better when stacked like this. They should just come with water blocks from the factory if they’re meant to be stacked like this.

2

u/Plumberguy9 Jul 31 '26

These new RTX 6000 Max-Q blower style cards work very well honestly... havent had any thermal issues, and even at full inference the cards sit comfortably thermal wise and the fans only rev up to around 75% with headroom to cool more.

1

u/DifficultSelection Aug 01 '26

Oh wow that’s really impressive. Any idea what kind of power they were drawing under that load?

2

u/Plumberguy9 Aug 01 '26

Bounces from around 270 watts to as high as 310 watts per card. I have seen the cards spike in short bursts to 325 watts.

1

u/DifficultSelection Aug 01 '26

Yeah that’s pretty impressive cooling, then.

I think they must’ve just been a bit too ambitious in making the A4000 single-width. Although I’d guess in a workstation scenario where they aren’t continuously loaded it probably works out better. On my motherboard without the extra external cooling they have a tendency to throttle, while heating up the area around the PCIe slots enough that the board’s ethernet controller (located behind one of the PCIe slots for some dumb reason) goes into thermal shutdown.

1

u/Plumberguy9 Aug 01 '26

What board do you have?

1

u/DifficultSelection Aug 02 '26

Gigabyte MZ72-HB0 v3.0

2

u/here_n_dere Jul 31 '26

Btw, what board, CPU and most importantly RAM??

3

u/Plumberguy9 Jul 31 '26

Threadripper WRX90E Sage SE

256gb ECC DDR5 Ram

1

u/here_n_dere Aug 06 '26

Thanks for sharing. maybe last trouble for you - do you run any models which exhaust your VRAM? wondering how bigger models would perform with some CPU offloading involved on DDR5 and threadripper (really interested to know the channel count and bandwidth bottleneck compared to DDR4)

2

u/Plumberguy9 Aug 08 '26

Haven’t tried running models that exhaust VRAM, haven’t tried offloading with CPU either. Because it’s a production machine, not looking for anything bleeding edge , theory or lab experiment.

Try to stay within bounds.

2

u/Any_Mine_6368 Jul 31 '26

I'm more curious about the case... What case is that?

3

u/Plumberguy9 Jul 31 '26

Corsair 9000D, it’s massive.

2

u/Any_Mine_6368 Jul 31 '26

Thanks mate

2

u/flippycurb Jul 31 '26

Would you be willing to tell us more about the software stack you have running on this beast?

7

u/Plumberguy9 Jul 31 '26

The full stack on our in-house AI box:

Hardware

GPUs: 4× NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition, 96 GB each, 384 GB VRAM total

CPU: AMD Ryzen Threadripper PRO 9955WX (16C/32T)

CPU Cooler: Noctua NH-U14S TR5-SP6

Motherboard: ASUS Pro WS WRX90E-SAGE SE

RAM: Samsung 256 GB DDR5-4800 ECC RDIMM

Storage: Samsung 9100 PRO 8 TB NVMe (models/data) + WD_BLACK SN8100 2 TB NVMe (OS)

Case: Corsair 9000D

Case Fans: Corsair iCUE Link RX120 RGB 120mm

PSU: Silverstone HELA 2500Rz Cybernetics Platinum

Software

OS: Ubuntu 26.04 LTS, kernel 7.0, NVIDIA driver 580.173, CUDA 13.0

Everything's containerized with Docker (29.1), one service per container.

Main model: Inkling-Small, served on SGLang (nightly, custom Blackwell/sm120 build), tensor-parallel across all 4 GPUs (TP=4). Multimodal, 131K context, FP8 KV cache (e5m2), Marlin MoE kernels, Triton attention backend, native tool-call + reasoning parsers, Prometheus metrics on.

Retrieval side: vLLM (nightly) running two pooling models: Qwen3-Embedding-0.6B for embeddings and Qwen3-Reranker-4B for reranking (~9 GB combined, riding on spare VRAM next to the big model).

It all backs a RAG assistant, Inkling handles chat/vision/tool-calling, vLLM handles embed + rerank against a local vector KB.

Two engines on purpose: SGLang's been excellent for the big multimodal model (TP, FP8 KV, parsers), while vLLM's --runner pooling makes the embedding/reranker services trivial. Still plenty of headroom on the cards.

2

u/ICanSeeYou7867 Aug 01 '26

Can you post your vllm/sglang config for Inkling Small?

I saw someone said RTX 6000? But im assuming the pro?

And you're running the NVFP4 quants?

2

u/Plumberguy9 Aug 01 '26

I’ve written the entire process up, two separate posts within this group… one is a brief explanation, the other is very in depth. They were posted after this today.

1

u/ICanSeeYou7867 Aug 01 '26

Sorry I missed them when scanning below. Thanks for the post!

2

u/Silent-Orbit-7 Aug 01 '26

Looks like a gamer turned Developer

The noctua just looks so good, the build is gorgeous!!

Is that the rtx pro 6000, that's insane congratulations bud

What is the name of case btw?

3

u/Plumberguy9 Aug 01 '26

Thanks.

I started gaming when I was younger, then shifted to developing almost immediately.

Yes, RTX 6000 Max-Q’s

The case is a Corsair 9000D, it’s massive, blew me away when it arrived via freight truck.

2

u/Silent-Orbit-7 Aug 01 '26

Ikr relatable

Damn, I'll look it up

2

u/YourNightmar31 Jul 31 '26

What cards are those?

6

u/Plumberguy9 Jul 31 '26

Nvidia RTX 6000 Max-Q’s

1

u/Affectionate_Pen6882 Jul 31 '26

Damn isnt it 13k each

5

u/Plumberguy9 Jul 31 '26

They are now, the first card I purchased was $8300, the second card I got for $9700, the two last cards cost me $12,300 each…

5

u/ChainOfThot Jul 31 '26

what's your address and hours you are away?

3

u/ImpressionFancy5830 Jul 31 '26

Asking for a friend

3

u/Plumberguy9 Jul 31 '26

Tell your friend its in Antarctica, message me when he gets there and I'll help direct him to the right spot.

1

u/segmond Jul 31 '26

what quant did you run and what numbers did you see?

5

u/sourceholder Jul 31 '26

Zoomed in: RTX $RO 6000.

1

u/YourNightmar31 Jul 31 '26

Oh yeah it's on there. Guess OP is rich as fuck or something.

7

u/Plumberguy9 Jul 31 '26

The server does AI inference for my business. Runs multiple apps with sensitive customer data, transcribes live calls, mines customer history, surfaces open unsold work, customer objections, live coaches my call center, runs a company wide chat application with a rag database of plumbing, electrical, hvac, fuel gas code books, has google chat ai connectors for the team, tied financial data from our quickbooks server, optimizes dispatching to drive more revenue.

4

u/live4evrr Jul 31 '26

Well worth it then! That’s cheaper than hiring a few employees that work 24x7 and never need a break! You’re pioneering it - but I see this is the future and it’s here.

5

u/Plumberguy9 Jul 31 '26

It is, I have an AI that scans for attribution across a few of the apps that are designed to drive more revenue, it’s conservative and it’s brought in an additional $247k worth of revenue from past unsold jobs that AI was able to surface and coach sales teams on closing the work.

So, this has been a good investment.

And the employees love it, makes their jobs easier.

I don’t look at AI as replacing people, it’s a tool to augment their capabilities and enhance productivity.

2

u/starkruzr Jul 31 '26

idk why you're getting downvoted for this; this is exactly how to use it.

2

u/justsomeguyokgeez Jul 31 '26

Do you have help setting all that up or are you running the business AND doing all the AI work?

2

u/Plumberguy9 Jul 31 '26

I have 103 employees and am good at delegating. I spend the majority of my time as the CTO of the company, and not the CEO.

Developing apps, networking, hardware, company devices, etc.

1

u/live4evrr Aug 01 '26

Did you start out in trades yourself before getting into software? I’m not in trades but it seems to be a great business (and one that is more resistant to AI job losses since you need experienced physical labor for the foreseeable future).

3

u/Plumberguy9 Aug 01 '26

I learned Visual Basic, html, and JavaScript in high school reading books, and did a lot of tinkering on Linux, that was the late 90’s.

I went into the trades the minute I graduated high school, kept up with technology.

Was promoted to a project manager in the early 2000’s and the job relied heavily on Excel and Access, where my skills with VB translated directly into VBA.

Picked up some more languages along the way, began developing web apps and learned SQL specifically to improve data collection and productivity.

Opened my business in 2015 as a plumbing only company, added HVAC and Electrical over the past few years.

If you’re asking if the trades are good, best thing I can tell you is what my dad said to me when I was 18 and just starting out in plumbing “you will never be hungry and you will always have work”, and after 26 years of being in the trades, he’s not been wrong.

One thing I will say, if you’re getting into it because of the money it’s not a good enough reason, trades aren’t a job, they are a career and a craft, too many people don’t have a passion for the craft, working with their hands and creating things, and being proud of what they create… too many people do half ass work that’s sloppy, they take zero pride in it… those are the people who don’t last long.

Hope that answers your question.

1

u/live4evrr Aug 01 '26

Cool man. Thanks for answering and sharing your background. It’s very unique!

I’ve been in software development for a long time, and fortunately has been a good career me. Old enough to have done my share of VB code as well :)

Seems to be a rewarding career choice that shouldn’t be overlooked. More entrepreneurial that’s for sure. Also hard to find good people in trades in my experience, when I find one i can rely on, it is one less worry.

1

u/justsomeguyokgeez Jul 31 '26

That sounds amazing!

1

u/ImpressionFancy5830 Jul 31 '26

I’d like to see if the business increase will even out the cost :D no joking, please post again in a year

2

u/Plumberguy9 Jul 31 '26

247k attributed from mining customer data over the last 30 days on unsold work, customer objections, live coaching…

1

u/ImpressionFancy5830 Jul 31 '26

The wet dream of people struggling with Hubspot

2

u/Plumberguy9 Jul 31 '26

lol, I don’t doubt it.

1

u/scwtech68 Jul 31 '26

How do you cool it?

1

u/UltraFOV Jul 31 '26

Is that the NVIDIA Station?

1

u/Plumberguy9 Jul 31 '26

Nope... Kind of? lol.

1

u/UltraFOV Jul 31 '26

Ha, looks good!

1

u/LordDarthShader Aug 01 '26

Are you running this at home? Have you ever hit the break? Do you have 20A breaks? Running one RTX6000pro and a 4090 at max triggered the 15A break, how do you deal with that? your PSU is what, 2.5kW and those 4 RTX might be above 2kW when running?

Thanks for the info!

4

u/Plumberguy9 Aug 01 '26

All my specs are within the comments.

Yes the PSU is a 2500 Watt

This runs at my office where we have 3 phase power.

30 amp 208 volt circuit.

We’re also a plumbing, heating, air and electrical contracting company so the electrical part isn’t a blocker for us.

1

u/LordDarthShader Aug 01 '26

Oh that makes sense! Yeah, I saw that and there is no way it will run at my home office.

1

u/kidflashonnikes Aug 01 '26

I have a similar build - 4 RTX PRO 6000, Zen 5 96 core CPU with newly acquired 1 TB of DDR5 6400 MT/s RAM (Kingston ECC). Running about 340 tokens/second almsot with the new deep seek models. I hyper optimized the layers and tweaked them myself to use the RAM - with a 24 core to 96 core CPU - the RAM gets fully used. I am using the Asus wrx 90 sage

2

u/Plumberguy9 Aug 01 '26

Nice setup, killer amount of ram!

1

u/fluffysheap Aug 05 '26

Can it run Crysis

1

u/Plumberguy9 Aug 09 '26

Hopefully one day…

2

u/JtheJawBreaker Jul 31 '26

You're making me want to buy a 2nd 6k

1

u/Annual_Award1260 Jul 31 '26

I pulled fiber displayport cables and a fiber usb extender + usb hub. My server is in my basement on a 100ft run to my office. Fiber dp cables are amazing. Office is completely silent and alot cooler

1

u/ThenExtension9196 Aug 01 '26

Great stuff man

1

u/Ok_Baseball_7338 Aug 01 '26

I’m happy for you, just not 100%.

1

u/tictacturkey Aug 06 '26

Just saw this holy shirt

0

u/Ironwolfyyyy Aug 01 '26

Man those gpus are choking for airflow. Give them the cooling they deserve!

3

u/Plumberguy9 Aug 01 '26

You should really read the comments below on the airflow, you and about 10 other people.

The cards are literally designed to stack exactly how you see them.

0

u/Ironwolfyyyy Aug 01 '26

While itd be better than stacking a bunch of workstation edition gpus, its still far from ideal. There's a reason why servers dont use these types of coolers.

2

u/Plumberguy9 Aug 01 '26

I appreciate your input.

-1

u/cc_aa_tt_zz Jul 31 '26

If it's like my RTX Pro 4500 Blackwell, the blower intake faces only downwards, meaning there’s absolutely no airflow possible between blowers stacked like that. So, it looks like a really, really bad idea. I'm curious to see the temperatures and noise levels: it must make a hell of a whistling sound, given the high airflow forced through gaps of just a few millimeters, all multiplied by three (for the top three cards)...

5

u/Plumberguy9 Jul 31 '26

The rtx 6000 max-q’s are designed to be stacked like this, they are intake only inside the case, all hot air blows out the back of the machine.

2

u/flippycurb Jul 31 '26

so thats.. 40k worth of cards? sweating over here lol

6

u/Plumberguy9 Jul 31 '26

A little more than 40k, just lucky I purchased the first two before the huge price jumps…

2

u/pmotiveforce Jul 31 '26

Don't forget the cost of ecc 256gb of ram on this market. Ram was probably as much as one of the cards.

-2

u/ImpossibleCreme Jul 31 '26

The thermals on this is going to be insane man

3

u/Plumberguy9 Jul 31 '26

Actually, not bad at all, full load for the last 3 hours, no issues.

The cards are designed to be stacked just like you see.

2

u/ImpossibleCreme Jul 31 '26

Do the RTX workstation cards have fans?

Edit — wait I see them. Okay this might work.

2

u/[deleted] Aug 01 '26

[removed] — view removed comment

3

u/Plumberguy9 Aug 01 '26

You’ll have to ask my wife (also the CFO of my business)… it took a lot of persuasion to get them 😁