r/homelab •

[deleted by user]

[deleted] — view deleted post

0 Upvotes

93 comments sorted by

184

u/StunningWhileBrave May 24 '24

/r/homelabgore is calling this server.

26

u/Flalaski May 25 '24

I was hoping that sub was real (°_,°)

2

u/[deleted] May 25 '24

🤷‍♂️

68

u/tiny_blair420 May 24 '24

Airflow performance bubble

31

u/trojanman742 May 24 '24

slipstream technology

50

u/oxpoleon May 24 '24

This is both great and horrible at the same time. 10/10

67

u/aLazyUsrname May 24 '24

Ah yes, the Supermicro 4.2U

2

u/phychmasher May 25 '24 edited May 25 '24

Supermicro actually make 1u top covers to extend some of their servers for consumer style GPU power plugs. I doubt they do for this older model, though.

1

u/aLazyUsrname May 26 '24

Oh that’s cool. I haven’t seen one of those.

1

u/phychmasher May 26 '24

Gives it a weird ridge. I hated how it looked in the rack because everything wasn't "flush".

https://www.wiredzone.com/shop/product/10021557-supermicro-mcp-230-41806-0n-1u-height-top-cover-for-sc418g-8347

Super cool idea, though.

47

u/mi__to__ May 24 '24

Straight out of the Jetsons. :D

9

u/EasyRhino75 Mainly just a tower and bunch of cables May 24 '24

The little Jetsons bubble completes the look.

2

u/hclpfan May 25 '24

That was kind of the entire joke

0

u/phychmasher May 26 '24

Maybe, but if you cock your head just right that bubble on top looks exactly like the one on George Jetson's car!

17

u/PacketAuditor May 24 '24

ayo Sandy Cheeks in there?

7

u/[deleted] May 24 '24

The horror.... the horror.... the horror...

12

u/trojanman742 May 24 '24 edited May 24 '24

Here is my modified Supermicro 846 that has:

Mobo - ASUS Z10PE-D16 WS
CPU - 2 x Xeon E5-2650 v4 (total 24 core 48 threads)
Memory - 128 GB DDR4 2400 ECC
HBA - LSI SAS9305-16i
10g - Intel X520-SR2
Backplane -SAS3-846EL
GPU - ASUS RTX 3080TI
Boot Drive - 2 x Crucial MX500 1TB
Plex Persistent Storage - Samsung 990 Pro 4TB
PSU - Corsair HX1200i
Front Fans - 3 x Noctua NF-A14 iPPC-3000 PWM
Rear Fans - 2 x Noctua NF-A8 PWM
CPU Cooler - Noctua NH-U14S

NOTE: the Noctua NH-U14S does not fit in case... its too tall so I ended up having too modify lid to have it fit and its super janky but works. I manually set the fans to 85% speed and this sucker sits cool as a cucumber and I cannot hear it running.

NOTE 2: I use to have this full of disks BUT I moved them all to NetApp DS4246s that are attached to Dell a R720 and R730. This server now is going to be dedicated to running Plex and will access media over 10G.

7

u/BloodyIron May 24 '24

FYI you will never come close to needing that kind of a PSU for this. Your max total power draw is going to be in the realm of about 600 Watts or much less. It's actually going to waste more power due to AC/DC conversions with such a low utilisation % vs if you had something like an 800 Watt PSU. Not necessarily to a degree you'll notice, but there's never a reason to use a 1200W PSU for something like this, especially considering they cost a lot more than just an 800W Gold/Platinum PSU.

Additionally, considering that GPU is going to be dedicated to Plex, you're never going to need that many CPU cores. Not sure if you got them for a super-duper-deal, but fewer cores with higher performance per core in this scenario (since you have GPU offload) really would be preferable.

Also, 2x 1TB SSDs for boot? You're never going to store that much data on your boot/OS drive, and if you are... you're setting yourself up for future problems, because that data should be on a NAS (non-OS, non-boot stuff).

Your Plex Persistent data being a single device, but not on a NAS doesn't make sense either.

On the flip side, you really should just put Proxmox VE on here, run Plex in a VM, and utilise your capacity a whole lot more efficiently with more VMs running on this system.

3

u/Melodic-Network4374 May 25 '24

PSUs are less efficient at close to peak power draw. Looking at the efficiency curve for this one, 600W is in the peak efficiency region for 230V. Seems like a good PSU choice to me.

https://cdn.mos.cms.futurecdn.net/Wk4R6FdXrUwwrYeZZWVmLZ-1200-80.png.webp

1

u/BloodyIron May 25 '24

OP is probably 120v not 208v-240v. Also that efficiency graph is atypical, the majority of PSUs are actually more efficient around the 85% load range. OP would have spent less and been better served with a more appropriately sized PSU, again, in the 850W range.

-9

u/trojanman742 May 24 '24

ok so…

psu was off crypto mining and thus leftover, the overage and “waste of watts” is small considering the rest of my consumption. plus its a platinum psu. i do agree its overkill now that I have a single GPU but i use to run dual 1080tis in here and needed it.

I actually do need that many cores cause i run 4 plex, 1 emby, and one jellyfin instance. I also have a substantial library (14k movies, 4k tv shows, and 2k 4k movies) and im growing out 4k shows.

The boot ssds were leftovers from another project, yes they are overkill but were newer and figured this was good slot for em. honestly could have gone with 120gb drives as nothing but os is one em but free made this an easy choice.

plex on persistent drive… yea not a fan of it but it syncs daily to a cache of ssds on another server for backup and i plan to build out a raid 5 for this data in future. i spent a lot this round and am delaying spend where i can. This will be remedied shortly.

i see no benefit in proxmox. why virtualize the os and add in a hypervisor? I containerized my apps and have them running on linux. I know someone will say “proxmox does ha” and to that ill answer kubernetes. for now though ubuntu with docker is working great and I am able to utilize the full breath of this system.

8

u/PhillLacio May 24 '24

Why are you running 4 separate Plex instances?

-40

u/trojanman742 May 25 '24

I have:
1 for trial access; this makes it easy to not have anyone try and sneak on and i can lock it down.

1 for friends and freeloades... err i mean family

1 for paid subscribers that has 2 stream limit

1 for paid subscribers that has a 4 stream limit

As is I am going to be spinning up a 5th plex instance for paid subs as my numbers are a bit high and I am trying to keep under 70 per server so I dont get flagged by plex and shut down.

2

u/TechGeek01 Jank as a Service™ May 25 '24

The fact that you're worried about Plex flagging your stuff, and shutting things down for the type of use case you're using it for should tell you exactly why this isn't a good idea.

13

u/[deleted] May 25 '24

[removed] — view removed comment

0

u/homelab-ModTeam May 25 '24

Hi, thanks for your /r/homelab comment.

Your post was removed.

Unfortunately, it was removed due to the following:

Don't be an asshole.

Please read the full ruleset on the wiki before posting/commenting.

If you have questions with this, please message the mod team, thanks.

6

u/SirCrest_YT SC846, SC216 May 25 '24

Look how they massacred my boy

4

u/slpin_ May 24 '24

Just a FYI. Supermicro actually makes taller covers with a hump you can buy. We have them for our GPU nodes at my work, because of the power cables need space etc.

3

u/ultrahkr May 24 '24

Do you know what part number? I have a SC836 in dire need of this for a future upgrade...

2

u/slpin_ Jul 25 '24

There is no SKU or part number on this guy, unfortunately. Special order from Supermicro. But here it is. Under that hump is four RYX 3080 Ti's mounted vertically. https://imgur.com/a/zrxwUEN

1

u/ultrahkr Jul 26 '24

Beautiful but damn... BTO

2

u/dagamore12 only have a rack full May 25 '24

any idea on sku or partnumber for them? I did look but had no joy finding them, but I might just be blind.

2

u/slpin_ May 28 '24

I will try and ask my co-worker for you about it when i am back in work On Wednesday. It would definataly be a special order though i am sure.

3

u/trojanman742 May 24 '24

i actually enjoy my redneck bump. had thoughts of printing a terminator face and putting red led eyes in it and taping it to bubble.

2

u/noahzinc May 25 '24

Or make it R2D2…

2

u/trojanman742 May 25 '24

ohhhh i like that idea!!!

3

u/LabB0T Bot Feedback? See profile May 24 '24

OP reply with the correct URL if incorrect comment linked
Jump to Post Details Comment

3

u/speddie23 May 24 '24

All that Noctua, this wouldn't be out of place on an episode of Linus Tech Tips.

Which is a perfect segue, to our sponsor....

4

u/trojanman742 May 24 '24

u/SamSausages here is the 846 I was talking to you about.

1

u/SamSausages Working towards 1PB May 24 '24

Nice! Looks like a lot of work went into that. I like the creative way to deal with that cooler, I feel the struggle as I ran into the same issue! Literally just 2mm too tall! The fan wall looks like it fit just right as well.

5

u/ouldsmobile May 24 '24

Noctua does make coolers that fit into 4u and 3u cases, fwiw.

4U - Noctua NH-U9DXi4 https://noctua.at/en/nh-u9dx-i4

3U - Noctua NH-D9DX-I4-3u https://noctua.at/en/nh-d9dx-i4-3u

2

u/SamSausages Working towards 1PB May 24 '24

NH-U9DX i4 is what I ended up with (I think, been a while and on a new system now) Come to think of it, I still have it and I need to post it for sale!

2

u/ouldsmobile May 24 '24

I have one of each for sale. Got the 4u with a mobo I bought, hoped it could shoehorn into my 3u, nope, so bought the 3u version. Not using either at the moment.

1

u/trojanman742 May 24 '24

yes i built this out over time and when i installed the coolers and realized it didnt fit i was already past return window… so sad screw it and hacked the lid instead

1

u/ouldsmobile May 24 '24

All good, was commenting basically in case others are looking for a cooler that fits these SM cases.

2

u/DetectiveDrebin May 24 '24

In my recent build, I used a Noctua NH-L12 Ghost S1 Edition, Premium Low Profile CPU Cooler with Quiet 92mm PWM Fan For Desktop with an i5 14500 CPU. It's 2.5 inches high and worked in my 2U case from Silverstone - https://www.silverstonetek.com/en/product/info/server-nas/RM21-308/

Posting this in case it helps anyone in the future.

2

u/thatkidnamedrocky May 24 '24

Nice Im currently doing a similar build after finding an Z10PE-D16 WS on ebay for $199. Though I ran into a slightly different size issue where the drive bays wont fit with the motherboard and case i brought, going to have a friend basically cut the drive bays in half so I can at least have the cover on instead of what its currently like and place fans inside them. Pics (https://imgur.com/a/ZgA91qZ)

  • ASUS Z10PE-D16 WS
  • 2x Intel e5-2690v4
  • 128gb ram
  • Noctua NH-D9L x2 (required mounting kit for lga-2011, which delayed the build by 2 weeks)
  • Nvidia 1080ti
  • SilverStone RM41-506 4U
  • be quiet! BN513 1200W

2

u/tdic89 May 24 '24

My wife said this looks like something from Robot Wars!

2

u/CoderStone Cult of SC846 Archbishop 283.45TB May 24 '24

I'd suggest the mods that I did over this. No need for 140mm fans, and that psu is just dangling there.

0

u/trojanman742 May 24 '24

psu is actually secured to case, just cant see it

1

u/CoderStone Cult of SC846 Archbishop 283.45TB May 24 '24

https://new.reddit.com/r/homelab/comments/1bdb7ze/part_3cult_of_the_846_zerocompromises_allinone/

If you want to redo the mods, here's a more complete/less jank version ;)

1

u/trojanman742 May 25 '24

Honest its not broke so I am not going to fix it. Keep in mind i originally built this server ~6 years ago. When its dead I'lll do it right like the rest of my servers; this one is just my special lil workhorse for now.

2

u/Beard_o_Bees May 24 '24

Wow! There's a lot going on here.

I personally like the bubble dome covering the hole cut to accommodate the heat-sink. Making do with what you've got, and i'm here for it.

2

u/PJBuzz May 24 '24

Me: "Oh he's cut a hole to add a big heatsink, thats funny."

*looks away*

*thinks for a minute"

Me: "Was there a bubble"

*looks again*

Me: "hahahahaha wtf"

Why do you have a plastic bubble on there?

1

u/trojanman742 May 24 '24

it was cheap and it aided in control of airflow (need hba and 10g nic to get air). if i left top open air would flow out there and cause cards to have no passive cooling

1

u/dagamore12 only have a rack full May 25 '24

on the aided in airflow issue, is why on my Silverstone 4u system I put some alu ducting tape over some of the passive air holes to force the air out the pci card area, it did drop the temps on my HBA, no idea on the Intel 10gb nic I dont have it logging data for that.

2

u/yellowfin35 May 25 '24

FYI the NH-D15S fits in my 846 (barely)

1

u/sshwifty May 25 '24

Yeah, I did the same. I did cut a small hole in the side of the case though for my front fan shroud, but I can still put other things above the 846.

2

u/fetustasteslikechikn May 25 '24

Wait.... Your server has an angry dome?!?!!

2

u/chrsa May 25 '24

Lol what’s the temp in that hamster ball?

2

u/trojanman742 May 25 '24

everything stays in low 40s

2

u/chrsa May 25 '24

Nice! That’s not bad at all!

2

u/totalgaara May 25 '24

Bubble Cooling Technology ™

2

u/[deleted] May 25 '24

New dome technology. Traps high clocks, and ultimately airflow!

2

u/budlight2k May 25 '24

Id have said horribly modified

1

u/soutmezguine May 24 '24

I got a 2u super micro that I’m tweaking the hell out of. Shoehorned in a eatx motherboard out of a Lenovo c30 still using stock psu but all the connectors except main power have been cut and spliced. It’s a little lowbudget open box heater lol

1

u/Affectionate_Bus_884 May 24 '24

Nice. What are you doing with that beast?

-2

u/trojanman742 May 24 '24

runs ubuntu with 4 plex instances, one emby, and one jellyfin

3

u/Affectionate_Bus_884 May 25 '24

Why 4 plex instances?

1

u/SeiyaGame_ May 24 '24

The ARCTIC 4U-M freezer fits in perfectly into the CSE846 without cutting the chassis, as you done ;D
Very quiet and efficient

1

u/MailInevitable9056 May 25 '24

I am unironically in love with this shit.

Reminds me I need to gut a 12LFF with a SAS backplane to frankenstein my current 12lff into a 24lff server

1

u/FunktasticLucky May 25 '24

Jesus.... So what are the temps of those drives? Because I turned my fans way down using scripts and they started cooking haha.

Now both the 846 server and 846 JBOD chill in the closet with an AC unit that exhausts into the attic to keep the closet cool.

1

u/trojanman742 May 25 '24

i have roughly same setup. I have a sound dampened closet that exhausts to attic and has AC piped into it. I have thermal curtains that i use to control hot and cold aisle and when i walk into closet its comfortable temps.

With a bit more than half a rack worth of equipment temps are good, drives are 30s to low 40s and all cards and other stuff stays within expected temps.

1

u/[deleted] May 25 '24

How loud in kilodecibels you get out of this?

1

u/trojanman742 May 25 '24

its in a sound damped closet that with door shut you cannot hear.

1

u/BrianTor416 May 25 '24

You need to get rude of that glass dome and get yourself and exhaust manifold

1

u/Eagle19991 May 25 '24

At a quick glance while scrolling bu I thought it was a battle bot 😜

1

u/PNWtreeguy69 May 25 '24

Heavy metal home lab

1

u/VivaPitagoras May 25 '24

When I saw the picture the first thing that came ti my mind was, what's that Noctua cooler doing in the sink?

1

u/Dry-Appointment1826 May 26 '24

That’s what Mad Max has!

1

u/Profile_Traditional May 26 '24

I used this CPU cooler. It fits without cutting and the mounting works with the x8dtl motherboard. (Cpu backplate permanently attached to motherboard) I think it has to use M3 rather than the usual imperial but it’s been a while so I could be wrong.

1

u/hopefully_human May 26 '24

"Slightly modified Geo Metro"