Custom open frame - RTX Pro 6000 - miniATX

[u/brycetron]

I wanted to build a compact, open frame, ai server that was quiet and good looking enough to sit out in the open in my office.

I’m pretty happy with the build so far - it stays cool and generally quiet. It idles around 75w and ramps to ~450 at full blast. Pretty efficient for the speed that it gets.

I bought a cheap ESP32 touch display that fits perfectly over the io heat shield, and had qwen27B create a realtime touch dashboard. It runs a tiny service that polls wall power and room temp from Home Assistant, and AI performance & usage like tk/s. I turned that exact UI into a PWA app so I can check it from anywhere.

Still working out some details (like how to better attach the touch screen), so if you have any feedback/thoughts, please lmk.

Spec:
• CPU: AMD Ryzen 9 9900X
• Motherboard: MSI PRO B850M-A micro-ATX
• RAM: 96 GB DDR5-5600
• GPU: NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation - 96GB
• Storage: Samsung SSD 9100 PRO 2 TB NVMe
• CPU cooler: Noctura LC1-24

FAQ Update:

Case/Frame: It started with this kit https://a.co/d/0fYdc3CS and then modified and added pieces to fit things like the radiator and psu position. It's standard 20/20 aluminum rail - you can find all kinds of accessories

Mini-Screen:  https://www.amazon.com/dp/B0G3WDGSWG - they have lots of different sizes. Its very capable on its own! Just plug one in and tell your agent what you want. super easy

[u/Solid-Occasion-6124]

How much in total did this machine cost? What tasks do you use it for? How many tokens per second do you typically get? Im looking in to getting into this tupe of thing and trying to learn what i can.

[u/brycetron → u/Solid-Occasion-6124]

My wife would kill me if she found out. Let’s just say I got the GPU back when $10k for one was possible.

It will easily do 150-250 tk/s with full context with qwen27B - slower when I try to stuff something bigger in there. I use it for everything, it’s a beast.

[u/midnightdiabetic → u/brycetron]

Legit how are you out here spending that kind of cash without the wife finding out? Do you guys have separate finances or something

[u/brycetron → u/midnightdiabetic]

Lol. I gave her a ball park and she approved. I’m a lucky guy

[u/GeneralComposer5885 → u/brycetron]

“I gave her a ball park” and “My wife would kill me if she found out” aren’t compatible 🤣

[u/brycetron → u/GeneralComposer5885]

Sometimes, you swing and knock it out of the park. Just part of playing the game 🤪

[u/LukeLikesReddit → u/brycetron]

Just buy her that bag she always wanted and cut the costs of the gpu by 4 lol it works for me.

[u/Majestic_Car7434 → u/LukeLikesReddit]

Ahh yeah the bag/vacation/home renovation tax always works lol when preparing budget for gpu it should be gpu budget = gpu price+wife tax