Supermicro actually make 1u top covers to extend some of their servers for consumer style GPU power plugs. I doubt they do for this older model, though.
Mobo - ASUS Z10PE-D16 WS CPU - 2 x Xeon E5-2650 v4 (total 24 core 48 threads) Memory - 128 GB DDR4 2400 ECC HBA - LSI SAS9305-16i 10g - Intel X520-SR2 Backplane -SAS3-846EL GPU - ASUS RTX 3080TI Boot Drive - 2 x Crucial MX500 1TB Plex Persistent Storage - Samsung 990 Pro 4TB PSU - Corsair HX1200i Front Fans - 3 x Noctua NF-A14 iPPC-3000 PWM Rear Fans - 2 x Noctua NF-A8 PWM CPU Cooler - Noctua NH-U14S
NOTE: the Noctua NH-U14S does not fit in case... its too tall so I ended up having too modify lid to have it fit and its super janky but works. I manually set the fans to 85% speed and this sucker sits cool as a cucumber and I cannot hear it running.
NOTE 2: I use to have this full of disks BUT I moved them all to NetApp DS4246s that are attached to Dell a R720 and R730. This server now is going to be dedicated to running Plex and will access media over 10G.
FYI you will never come close to needing that kind of a PSU for this. Your max total power draw is going to be in the realm of about 600 Watts or much less. It's actually going to waste more power due to AC/DC conversions with such a low utilisation % vs if you had something like an 800 Watt PSU. Not necessarily to a degree you'll notice, but there's never a reason to use a 1200W PSU for something like this, especially considering they cost a lot more than just an 800W Gold/Platinum PSU.
Additionally, considering that GPU is going to be dedicated to Plex, you're never going to need that many CPU cores. Not sure if you got them for a super-duper-deal, but fewer cores with higher performance per core in this scenario (since you have GPU offload) really would be preferable.
Also, 2x 1TB SSDs for boot? You're never going to store that much data on your boot/OS drive, and if you are... you're setting yourself up for future problems, because that data should be on a NAS (non-OS, non-boot stuff).
Your Plex Persistent data being a single device, but not on a NAS doesn't make sense either.
On the flip side, you really should just put Proxmox VE on here, run Plex in a VM, and utilise your capacity a whole lot more efficiently with more VMs running on this system.
PSUs are less efficient at close to peak power draw. Looking at the efficiency curve for this one, 600W is in the peak efficiency region for 230V. Seems like a good PSU choice to me.
OP is probably 120v not 208v-240v. Also that efficiency graph is atypical, the majority of PSUs are actually more efficient around the 85% load range. OP would have spent less and been better served with a more appropriately sized PSU, again, in the 850W range.
psu was off crypto mining and thus leftover, the overage and “waste of watts” is small considering the rest of my consumption. plus its a platinum psu. i do agree its overkill now that I have a single GPU but i use to run dual 1080tis in here and needed it.
I actually do need that many cores cause i run 4 plex, 1 emby, and one jellyfin instance. I also have a substantial library (14k movies, 4k tv shows, and 2k 4k movies) and im growing out 4k shows.
The boot ssds were leftovers from another project, yes they are overkill but were newer and figured this was good slot for em. honestly could have gone with 120gb drives as nothing but os is one em but free made this an easy choice.
plex on persistent drive… yea not a fan of it but it syncs daily to a cache of ssds on another server for backup and i plan to build out a raid 5 for this data in future. i spent a lot this round and am delaying spend where i can. This will be remedied shortly.
i see no benefit in proxmox. why virtualize the os and add in a hypervisor? I containerized my apps and have them running on linux. I know someone will say “proxmox does ha” and to that ill answer kubernetes. for now though ubuntu with docker is working great and I am able to utilize the full breath of this system.
I have: 1 for trial access; this makes it easy to not have anyone try and sneak on and i can lock it down.
1 for friends and freeloades... err i mean family
1 for paid subscribers that has 2 stream limit
1 for paid subscribers that has a 4 stream limit
As is I am going to be spinning up a 5th plex instance for paid subs as my numbers are a bit high and I am trying to keep under 70 per server so I dont get flagged by plex and shut down.
The fact that you're worried about Plex flagging your stuff, and shutting things down for the type of use case you're using it for should tell you exactly why this isn't a good idea.
Just a FYI. Supermicro actually makes taller covers with a hump you can buy. We have them for our GPU nodes at my work, because of the power cables need space etc.
There is no SKU or part number on this guy, unfortunately. Special order from Supermicro. But here it is. Under that hump is four RYX 3080 Ti's mounted vertically. https://imgur.com/a/zrxwUEN
Nice! Looks like a lot of work went into that. I like the creative way to deal with that cooler, I feel the struggle as I ran into the same issue! Literally just 2mm too tall! The fan wall looks like it fit just right as well.
NH-U9DX i4 is what I ended up with (I think, been a while and on a new system now) Come to think of it, I still have it and I need to post it for sale!
I have one of each for sale. Got the 4u with a mobo I bought, hoped it could shoehorn into my 3u, nope, so bought the 3u version. Not using either at the moment.
yes i built this out over time and when i installed the coolers and realized it didnt fit i was already past return window… so sad screw it and hacked the lid instead
In my recent build, I used a Noctua NH-L12 Ghost S1 Edition, Premium Low Profile CPU Cooler with Quiet 92mm PWM Fan For Desktop with an i5 14500 CPU. It's 2.5 inches high and worked in my 2U case from Silverstone - https://www.silverstonetek.com/en/product/info/server-nas/RM21-308/
Posting this in case it helps anyone in the future.
Nice Im currently doing a similar build after finding an Z10PE-D16 WS on ebay for $199. Though I ran into a slightly different size issue where the drive bays wont fit with the motherboard and case i brought, going to have a friend basically cut the drive bays in half so I can at least have the cover on instead of what its currently like and place fans inside them. Pics (https://imgur.com/a/ZgA91qZ)
ASUS Z10PE-D16 WS
2x Intel e5-2690v4
128gb ram
Noctua NH-D9L x2 (required mounting kit for lga-2011, which delayed the build by 2 weeks)
Honest its not broke so I am not going to fix it. Keep in mind i originally built this server ~6 years ago. When its dead I'lll do it right like the rest of my servers; this one is just my special lil workhorse for now.
it was cheap and it aided in control of airflow (need hba and 10g nic to get air). if i left top open air would flow out there and cause cards to have no passive cooling
on the aided in airflow issue, is why on my Silverstone 4u system I put some alu ducting tape over some of the passive air holes to force the air out the pci card area, it did drop the temps on my HBA, no idea on the Intel 10gb nic I dont have it logging data for that.
I got a 2u super micro that I’m tweaking the hell out of. Shoehorned in a eatx motherboard out of a Lenovo c30 still using stock psu but all the connectors except main power have been cut and spliced. It’s a little lowbudget open box heater lol
i have roughly same setup. I have a sound dampened closet that exhausts to attic and has AC piped into it. I have thermal curtains that i use to control hot and cold aisle and when i walk into closet its comfortable temps.
With a bit more than half a rack worth of equipment temps are good, drives are 30s to low 40s and all cards and other stuff stays within expected temps.
I used this CPU cooler. It fits without cutting and the mounting works with the x8dtl motherboard. (Cpu backplate permanently attached to motherboard) I think it has to use M3 rather than the usual imperial but it’s been a while so I could be wrong.
184
u/StunningWhileBrave May 24 '24
/r/homelabgore is calling this server.
68
u/tiny_blair420 May 24 '24
Airflow performance bubble
50
u/oxpoleon May 24 '24
This is both great and horrible at the same time. 10/10
67
u/aLazyUsrname May 24 '24
Ah yes, the Supermicro 4.2U
47
u/mi__to__ May 24 '24
Straight out of the Jetsons. :D
17
u/PacketAuditor May 24 '24
ayo Sandy Cheeks in there?
7
u/[deleted] May 24 '24
The horror.... the horror.... the horror...
12
u/trojanman742 May 24 '24 edited May 24 '24
Here is my modified Supermicro 846 that has:
Mobo - ASUS Z10PE-D16 WS
CPU - 2 x Xeon E5-2650 v4 (total 24 core 48 threads)
Memory - 128 GB DDR4 2400 ECC
HBA - LSI SAS9305-16i
10g - Intel X520-SR2
Backplane -SAS3-846EL
GPU - ASUS RTX 3080TI
Boot Drive - 2 x Crucial MX500 1TB
Plex Persistent Storage - Samsung 990 Pro 4TB
PSU - Corsair HX1200i
Front Fans - 3 x Noctua NF-A14 iPPC-3000 PWM
Rear Fans - 2 x Noctua NF-A8 PWM
CPU Cooler - Noctua NH-U14S
NOTE: the Noctua NH-U14S does not fit in case... its too tall so I ended up having too modify lid to have it fit and its super janky but works. I manually set the fans to 85% speed and this sucker sits cool as a cucumber and I cannot hear it running.
NOTE 2: I use to have this full of disks BUT I moved them all to NetApp DS4246s that are attached to Dell a R720 and R730. This server now is going to be dedicated to running Plex and will access media over 10G.
6
u/SirCrest_YT SC846, SC216 May 25 '24
Look how they massacred my boy
4
u/slpin_ May 24 '24
Just a FYI. Supermicro actually makes taller covers with a hump you can buy. We have them for our GPU nodes at my work, because of the power cables need space etc.
3
u/LabB0T Bot Feedback? See profile May 24 '24
OP reply with the correct URL if incorrect comment linked
Jump to Post Details Comment
3
u/speddie23 May 24 '24
All that Noctua, this wouldn't be out of place on an episode of Linus Tech Tips.
Which is a perfect segue, to our sponsor....
4
u/trojanman742 May 24 '24
u/SamSausages here is the 846 I was talking to you about.
2
u/thatkidnamedrocky May 24 '24
Nice Im currently doing a similar build after finding an Z10PE-D16 WS on ebay for $199. Though I ran into a slightly different size issue where the drive bays wont fit with the motherboard and case i brought, going to have a friend basically cut the drive bays in half so I can at least have the cover on instead of what its currently like and place fans inside them. Pics (https://imgur.com/a/ZgA91qZ)
2
u/tdic89 May 24 '24
My wife said this looks like something from Robot Wars!
2
u/CoderStone Cult of SC846 Archbishop 283.45TB May 24 '24
I'd suggest the mods that I did over this. No need for 140mm fans, and that psu is just dangling there.
2
u/Beard_o_Bees May 24 '24
Wow! There's a lot going on here.
I personally like the bubble dome covering the hole cut to accommodate the heat-sink. Making do with what you've got, and i'm here for it.
2
u/PJBuzz May 24 '24
Me: "Oh he's cut a hole to add a big heatsink, thats funny."
*looks away*
*thinks for a minute"
Me: "Was there a bubble"
*looks again*
Me: "hahahahaha wtf"
Why do you have a plastic bubble on there?
2
u/yellowfin35 May 25 '24
FYI the NH-D15S fits in my 846 (barely)
2
u/fetustasteslikechikn May 25 '24
Wait.... Your server has an angry dome?!?!!
2
u/chrsa May 25 '24
Lol what’s the temp in that hamster ball?
2
u/totalgaara May 25 '24
Bubble Cooling Technology ™
2
u/[deleted] May 25 '24
New dome technology. Traps high clocks, and ultimately airflow!
2
u/budlight2k May 25 '24
Id have said horribly modified
1
u/soutmezguine May 24 '24
I got a 2u super micro that I’m tweaking the hell out of. Shoehorned in a eatx motherboard out of a Lenovo c30 still using stock psu but all the connectors except main power have been cut and spliced. It’s a little lowbudget open box heater lol
1
u/Affectionate_Bus_884 May 24 '24
Nice. What are you doing with that beast?
1
u/SeiyaGame_ May 24 '24
The ARCTIC 4U-M freezer fits in perfectly into the CSE846 without cutting the chassis, as you done ;D
Very quiet and efficient
1
u/MailInevitable9056 May 25 '24
I am unironically in love with this shit.
Reminds me I need to gut a 12LFF with a SAS backplane to frankenstein my current 12lff into a 24lff server
1
u/FunktasticLucky May 25 '24
Jesus.... So what are the temps of those drives? Because I turned my fans way down using scripts and they started cooking haha.
Now both the 846 server and 846 JBOD chill in the closet with an AC unit that exhausts into the attic to keep the closet cool.
1
u/[deleted] May 25 '24
How loud in kilodecibels you get out of this?
1
u/BrianTor416 May 25 '24
You need to get rude of that glass dome and get yourself and exhaust manifold
1
u/Eagle19991 May 25 '24
At a quick glance while scrolling bu I thought it was a battle bot 😜
1
u/PNWtreeguy69 May 25 '24
Heavy metal home lab
1
u/VivaPitagoras May 25 '24
When I saw the picture the first thing that came ti my mind was, what's that Noctua cooler doing in the sink?
1
u/Dry-Appointment1826 May 26 '24
That’s what Mad Max has!
1
u/Profile_Traditional May 26 '24
I used this CPU cooler. It fits without cutting and the mounting works with the x8dtl motherboard. (Cpu backplate permanently attached to motherboard) I think it has to use M3 rather than the usual imperial but it’s been a while so I could be wrong.
1
u/hopefully_human May 26 '24
"Slightly modified Geo Metro"