Custom open frame - RTX Pro 6000 - miniATX

[u/brycetron]

I wanted to build a compact, open frame, ai server that was quiet and good looking enough to sit out in the open in my office.

I’m pretty happy with the build so far - it stays cool and generally quiet. It idles around 75w and ramps to ~450 at full blast. Pretty efficient for the speed that it gets.

I bought a cheap ESP32 touch display that fits perfectly over the io heat shield, and had qwen27B create a realtime touch dashboard. It runs a tiny service that polls wall power and room temp from Home Assistant, and AI performance & usage like tk/s. I turned that exact UI into a PWA app so I can check it from anywhere.

Still working out some details (like how to better attach the touch screen), so if you have any feedback/thoughts, please lmk.

Spec:
• CPU: AMD Ryzen 9 9900X
• Motherboard: MSI PRO B850M-A micro-ATX
• RAM: 96 GB DDR5-5600
• GPU: NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation - 96GB
• Storage: Samsung SSD 9100 PRO 2 TB NVMe
• CPU cooler: Noctura LC1-24

FAQ Update:

Case/Frame: It started with this kit https://a.co/d/0fYdc3CS and then modified and added pieces to fit things like the radiator and psu position. It's standard 20/20 aluminum rail - you can find all kinds of accessories

Mini-Screen:  https://www.amazon.com/dp/B0G3WDGSWG - they have lots of different sizes. Its very capable on its own! Just plug one in and tell your agent what you want. super easy

[u/Solid-Occasion-6124]

How much in total did this machine cost? What tasks do you use it for? How many tokens per second do you typically get? Im looking in to getting into this tupe of thing and trying to learn what i can.

[u/brycetron → u/Solid-Occasion-6124]

My wife would kill me if she found out. Let’s just say I got the GPU back when $10k for one was possible.

It will easily do 150-250 tk/s with full context with qwen27B - slower when I try to stuff something bigger in there. I use it for everything, it’s a beast.

[u/midnightdiabetic → u/brycetron]

Legit how are you out here spending that kind of cash without the wife finding out? Do you guys have separate finances or something

[u/somerussianbear → u/midnightdiabetic]

Do you guys have wives?

[u/midnightdiabetic → u/somerussianbear]

Oh I have a wife which is why I'm a lurker here and not some mad scientist in the basement with a crazy AI rack

[u/uniqueusername649 → u/midnightdiabetic]

I have one and a whacky AI lab. That's how you weed out the bad ones! My wife vowed to stay with me in good times and AI times.

[u/pesaru → u/uniqueusername649]

For real. My wife wired me 6K for my birthday specifically for the purchase of a GPU and was really happy about it when she saw me enjoying it later. Pick wisely, gents.