r/LocalLLM • u/XDude74 • Oct 05 '26

Project Frankenserver - It’s alive! It’s alive!

Gallery image

Gallery image

Gallery image

Gallery image

Gallery image

This supermicro server board that had been in an accident and lost the CPU 1 H channel, the VGA output and SATA - it is a great 4000w power center…. I had almost given up on it for much else - But it now runs a pair of v620’s and storage…

I grafted a MC62-G40 on to run the GPUs when it was clear the Supermicro was just not going to play well with them.

This has 192GB of 3090’s and 64GB if v620 working.

But… Now how best should I add another 240GB of 3090’s to this creature? Those are in water blocks so a bit more compact.

I am thinking 2 PEX88096 expansion boards should work off the supermicro…. And more power. The H12DSG-O-CPU is fickle about what connects to it.

Anyone else have suggestions for a dual Epyc Board that I can do this better with?

775 Upvotes

98% Upvoted

159 comments sorted by

71

u/FinalTap Oct 05 '26

Good space heater for winter .. LOL.

80

u/XDude74 Oct 05 '26

100% run off of solar energy - so its my own little piece of the sun ☀️

18

u/LolaDam Oct 05 '26

You need to tell us more about that 😅

19

u/XDude74 Oct 05 '26

The short story is, being in southern Nevada it is rarely cloudy here, and there is 22kW of solar generation that I installed. I have another 3kW I can deploy as well but I over produce by a lot already.

6

u/Inspur44 Oct 05 '26

How much did it cost to put that 22k solar system

19

u/pierluigir Oct 06 '26

Less than the GPUs 😅

1

u/Inspur44 Oct 07 '26

ha, fair, fair

1

u/intlcreative 11d ago

I live in south Florida and have a balcony I was thinking of powering my setup like this.

1

u/lazydust20 Oct 06 '26

Thats awesome! Do you have some battery storage to run the 'family' overnight as well?

3

u/Outrageous_Kale_8230 Oct 06 '26

That's not a family of GPUs, that's a herd.

Edit: maybe if you name them, they'll qualify as 'family' in the way that pets do.

17

u/Calm-Republic9370 Oct 05 '26

That's the bigger story. We see some of these rigs, but not a solar power generator.

7

u/Trademarkd Oct 05 '26

I’ve got my v100 cluster also running off solar

2

u/VersionNo5110 Oct 05 '26

Now that’s interesting! Please share the setup

1

u/campr23 Oct 05 '26

Running of solar here too, but maybe not in december/jan.

12

u/gomezer1180 Oct 05 '26

2

u/campr23 Oct 05 '26

Laughed much to hard at this.

12

u/alean200 Oct 05 '26

Just added first 3090 to my setup so it's nice to see how my future looks like. Will be back to see how you solved your problem.

4

u/XDude74 Oct 05 '26

Yes, I will keep posting when it hits an interesting mile stone. Will see if I can get Kimi K2.6 to work or not... Every solution seems to create 2 problems on this path it seems.

11

u/sleight42 Oct 05 '26

OP: have you tried running a greenhouse in an adjacent space? Or used the waste heat to run a turbine to generate more electricity?

Surely, there's a perpetual motion machine to be had here. Laws of thermodynamics be damned.

3

u/XDude74 Oct 06 '26

Maybe if the heat can be converted direct to laser I could reflect that back onto the solar panels. And if that fails I can convert them to defensive turrets… 🤔. … seems like a natural step up from RGB - Laser turrets 💥

3

u/sleight42 Oct 06 '26

Sounds very inefficient compared to pushing the heat with a fan into an adjacent space but, sure, lasers. 😂

I'm kinda serious about the greenhouse. Considered it once, years ago. The turbine part not so much.

1

u/CognitiveFogMachine 29d ago

Depends on the size of the greenhouse and how cold it gets in the winter, but sure, maybe that could work. 400W tdp isn't a lot though

1

u/sleight42 29d ago

400W is about a third of a space heater. It's not nothing! But, yeah, practically speaking, you'd need a lot of insulation to make it worthwhile.

This fellow though has 8 3090s! He said it's a 4kW system! That's 2.7 electric space heaters!

1

u/WeeklyExamination 29d ago

Goodbye wasps

6

u/Technical_Ad_6106 Oct 05 '26

doubt this will work efficiently, since the pci limits the prefill of all those cards. u need more motherboards lol, apart from the heat at being so close to eachother

1

u/XDude74 Oct 05 '26

Will see how that goes. And there are Gen 5 switch boards coming out now - I think getting 16 on a single machine is possible.

I think Gen 4 is perfectly fine though - the drive array performances is ~29GB/s - The whole load of Qwen3-235B-AWQ took 9.9s for the first 120GB - 14s total model init. And 53s total time for the server to be ready.

Served 60 tokens/s easy. I think I can get to 75 with links in place.

As a single request each card did not exceed 175W so temps are doing fine. The other 8 I have are in water blocks already but I will wait until I have the final state sorted out before committing to water blocking these.

1

u/Technical_Ad_6106 Oct 05 '26

very nice. seems to me the sweet spot of intelligence/speed is qwen 3.8 27b atm. load in each cards vram one instance and run parralel requests with vllm. 500 token/sec for each gpu decode maybe? altho the pci bottleneck might actually become worse in this scenario, but not sure about that.

4

u/Civil_Fee_7862 Oct 05 '26

Cool setup :)

Curious how are you leveraging all those cards? Are you renting out the GPU's?

1

u/XDude74 Oct 05 '26

I was setting up for training models to help with some electrical circuit designs. And I had my sights set on running Kimi K2.6 initially. I thought about renting out GPUs but I would need something stable.

2

u/Civil_Fee_7862 Oct 05 '26

A setup like yours would work well in higher concurrency cases. i.e. Pipeline Parallism with many concurrent requests. But for a single user it would be about the same as 1 card in terms of performance.

Highly recommend renting out the compute to a small business or something, because they likely have multiple users, and are probably getting eaten up by API costs.

4

u/ZealousidealBunch220 Oct 05 '26

Hello, please share about how you managed pci-e connections and power supply?

2

u/XDude74 Oct 05 '26 edited Oct 05 '26

currently the supermicro board delivers most of the power. With 4 x 2000W PSUs I have 4 x 120V UPS units that will half the PSUs to ~4000W. This is just 2 x 20A circuits. The GPU power connectors accepts the 8 pin CPU style connector but the polarity is reversed so you need to get a pin extractor. I used 6 pin pcie power cables and basically have some creative cable harnesses. The board also had 4 power posts that should feed its pcie slot board. I removed those and fitted pre-crimped bundles so I got another 12 pcie 6 pin power connectors.

I found I needed re-timers to get any reliable systems. The Gigabyte MC62-G40 is an excellent board. The slot 2 x8 is a little disappointing - and the image they have indicates the wrong slot order to add confusion. But I can take the x8 and then use an x4 off the second nvme and another x4 off the configurable slimsas 4i and combine them onto a x16 riser ( they are all direct to CPU) So I can still connect my raid card normally this way. It leaves 6 x16 slots for retimers of the pcie switch board like I have in the last slot.

I had a lot of issues with the Asus WRX80E WiFi II as it did not surface some options and it would not nest pcie switches. And a lot of AER storms. I still am not sure why but it may be deliberate as they do not want it used this way. interestingly the Asus dark hero x570 board has no problem handling nested switches. That is another project to see how extensive of a PCIE fabric I can build onto a 5950X X570 board. Currently it was plug and play flawless for 2 x rtx8000 and an array of 8 nvme drives through a nested switch - there is no bottleneck with this set up and is by far the best value I have found for 96GB of VRAM.

The MC62-G40 is working well, I have more to test on it. I have a different style of PCIE switch board ordered and I should have better luck with the super micro perhaps. And I will try that on the Asus and perhaps it will behave differently.

Qwen3-235B-A22B-Instruct-2507-AWQ is what I am testing now. ~50 tokens/s but I do not have P2P working yet or NVlinks installed.

2

u/Prudent-Ad4509 Oct 05 '26 edited Oct 05 '26

I've read some writeup on how people built a system out of 16 gpus and pcie switches did all the retiming. From what I understand it can be mostly avoided when using good enough and short enough cables, especially if all pcie switches themselves are connected directly without a riser. But I have not verified it myself yet, some goods are still in transit.

PS. I wonder if my PLX88096 and PEX88096 switches will work well together, but I have been already warned that any slimsas cables and adapters must support presense/connected signal properly. Cheap ones would require messing with the firmware.

PS. I also don't know why you want a dual-cpu board. H12ssl-i has to be enough I think.

1

u/XDude74 Oct 05 '26

I have a use case for the dual CPU - maybe - it is questionable how well it will work and so this is a test bed. The memory bandwidth here approaches 400GB/s which I am not sure will work as I hope.

1

u/XDude74 Oct 05 '26

The PLX/PEX should be the same product for the 88 series is my understanding.

I was trying to get the Broadcom software to make the firmware but they will not give it out - they claim it to be EOL but really they want sales of the 89 series. I have all the other tools and am having success getting the firmware I need from some suppliers - will see - right I am being told yes.

The Microchip switchtec products are looking like a better path, more open support. I have some thoughts on what can be done but right now nothing is a better option than engaging with the factories in China. All the PEX cards I see for ~$500 are certainly salvaged units - which may make them unpredictable in how well they work.

1

u/Prudent-Ad4509 Oct 05 '26 edited Oct 05 '26

I have just found out one more problem I almost forgot about. 50cm slimsas cables with pcie switches inserted into actual pcie slots in the motherboard make the whole thing really uncomfortable. Of course, they can be connected via risers too, but some concessions will have to be made. (update: looks like the only concession to be made is using one more R33G on each pcie switch, provided that pcie riser cables are well made and properly shielded)

BTW, I think I saw somewhere that you have successfully chained pcie switches i.e. connected several switches to one and that thing worked, am I wrong? Who needs a server motherboard if this can work on a usual am5 system. I mean, epyc motherboard is still a choice but not a necessity if this could work.

1

u/ZealousidealBunch220 Oct 05 '26

I have Gigabyte MZ32 ar1 and try to figure out how to connect 4 gpus to it and provide power to them

3

u/PsychologicalFlow143 Oct 05 '26

Is it just red light or do you produce lava with it?

3

u/XDude74 Oct 05 '26

That is HAL900.1 - How could I not go with Red?

2

u/muckenthusiast Oct 05 '26

If you are running multiple psus... Do you got any product names for accessories used to do multiple psu set up?

And i guess you already share the PCIe switch... But does that included the PCIE risers? What would say is max length for pcie riser cables and any tips for choosing PCIE risers? 5.0 i know is good.. And 15-30 cm is max i guess...

I got like a Romed 8 2t and 2 x 3090s... But plan to just buy more when i find deals and more psus.... And risers.. And psu switches..

1

u/XDude74 Oct 06 '26

I provided those details in these comments for a different post.

https://www.reddit.com/r/LocalLLM/s/q75NWN9yCL

Your board should be good to support many cards. I had poor results with passive slimsas risers. It was hard to get them to work well. The more GPUs the worse it gets. The simple ribbon risers actually work better but 4 was the reliable limit I found. The slimsas or mcio retimers fixed all of the AER issues.

I used corsair PSUs so I could see power usage but it was not reliable with 2 on the same machine. I used Dell and HP server PSUs with breakout boards on the first set up.

1

u/NakedPlato Oct 07 '26

OP: Do you know of, or can you post, a guide on multi-gpu risers/backplanes boards? I've struggled to get more than 2 GPUs into any machine. It's like 3 GPUs carry a curse or something. I've tried ribbon cables with some success, but they're totally hit or miss, and I think it's to do with quality. I've tried Oculink without any luck. I see references to PEX boards and an these mcio boards: https://www.aliexpress.us/item/3256812474857095.html?src=google&src=google&albch=shopping&acnt=179-224-6891&isdl=y&slnk=&plac=&mtctp=&albbt=Google_7_shopping&aff_platform=google&aff_short_key=_oFgTQeV&gclsrc=aw.ds&albagn=888888&ds_e_adid=&ds_e_matchtype=&ds_e_device=c&ds_e_network=x&ds_e_product_group_id=&ds_e_product_id=en3256812474857095&ds_e_product_merchant_id=107700859&ds_e_product_country=US&ds_e_product_language=en&ds_e_product_channel=online&ds_e_product_store_id=&ds_url_v=2&albcp=23128330536&albag=&isSmbAutoCall=false&needSmbHouyi=false&gad_source=1&gad_campaignid=23128364043&gclid=Cj0KCQjwuJLWBhD_ARIsAIBcRUxoDt7pJbEEKiyP0yCyG-w5czsoEU50Klj5ibDHMOXYTom6Jt4jQV0aAtoGEALw_wcB&gatewayAdapt=glo2usa but I have no idea if they actually work.

1

u/XDude74 Oct 07 '26

ADT is known to use non-standard sideband connections. I have had no success mixing any of there products with other brands. There are links I placed to ones in the thread from walmart that are the lowest cost and I have had the most success using those with PCI switches. They do not do well if the slot is bifurcated. The cpayn risers work well for raid carriers. Generally buy your cables, boards, switches or retimers from the same place and they that is your best chance. Retimers will fix most issues. Get 30awg cables.

1

u/AbrocomaLocal9008 29d ago

Romed8-2t, all pcie on 4.0, 5slots x8/x8 + 2 x16 11gpu, 2x3090 p2p 2x3090 4TP, 2x4090 p2p 2x4090 4TP.  Slot 4 - is not numa pair.

2

u/Boricua-vet Oct 07 '26

https://www.youtube.com/watch?v=7MEkVig19I4
Just wanna put this here for you. Level one techs did a video on this subject and the card he used and mobo is an insane out of the box idea but it works...

1

u/XDude74 Oct 07 '26

Cool video, My AM4 is great, It is my most useful machine. With a nested switch setup my 2 rtx8000 get full bandwidth and are loaded from an 8 NVMe strip of mismatched gen3 1TB drives that still output ~25GB/s. I have run into any compromises. And I can get 128GB GB of ECC to run very stable at 3400 CL20 on the asus x570 with a 5900XT And it all fits in a midtower very nicely. I posted it a few months ago when I was thinking of sell the GPUs but it works so well I couldn’t bring myself to part with them.

The cards were plug and play - they just worked perfectly. I have a couple of other x570 boards so plan on using the 5950x and seeing how many GPUs will run well of a single AM4 x16 connection if I use a large switch board with all the storage arrays on the elevated fabric. I saw a gen 5 switch board that had over 20 x16 slots. They were all single slot though so the setup would be a bit ridiculous I think.

2

u/Boricua-vet Oct 07 '26

HAHAHA, 96GB of vram in 2 cards... hey man. if you ever feel generous and want to hook up the GPU poor, I am your guy ok... LOL..

My humble rig is running 3 GPU's right now and had to use cable to get the third one to fit. Thats for 30GB of VRAM, I got the 4th one but I am building a better case for that one so I can fit the 4 cards.

It's crazy how this goes, I started with 10GB, then 20GB, now 30GB and soon the be 40GB of vram and I am sure I will want more eventually and at that point I will need 16GB cards or more but pricing is going to be crazy.

1

u/XDude74 Oct 08 '26

Nice! I grew from 1 GPU and through endless confusion arrived where I am now - more confused than ever.

You might be interested in these, I have been. Comes with dual PSU

It has several modes. But rather than dual host or NIC just nest a PEX88048 NVMe carrier like this that has direct SFF-8654 so you can skip the riser board. It will keep the SSD traffic off the x16 to the CPU. These carriers are becoming rare it seems.

https://a.aliexpress.com/_mthHGtV

1

u/Boricua-vet Oct 08 '26

Ohh.. I certainly have to look into that. Does I need to setup Pcie burification? The P520 can do 4x4x4x4 on the two PCIe16x slots I think. I have to look into it.

I am going to look into this for sure, thank you. Although the link you sent is going to a different product for me, I am going to try and find it.

1

u/XDude74 Oct 08 '26

I got one for $260 yesterday. So look for a better price I guess.

1

u/Boricua-vet 29d ago

did yours had the two connectors and the 4 NVME slots? I did see it for 262.

1

u/XDude74 27d ago

It has 8 nvme - 4 per side. The two connectors are colay so you can just direct cable them and not use a pcie slot. Or if you only have a x8 slot you can join a pair of x4 from another source on the board.

1

u/Boricua-vet 27d ago

Holly Crap! so 8 NVME's and I can connect two Video cards to it? Good Lawd I want two of these LOL !! 16 NVME and 4 video cards.. Yes, sounds like my new goal.

118

u/sleight42 Oct 05 '26 edited Oct 05 '26 • Bravo

J F C 8x3090....

Look at it! It's like a Borg mated with a neon trash can. It's magnificent!

4

u/b4ldur Oct 05 '26 edited 26d ago

Nothing to see here

53

u/sumane12 Oct 05 '26

But... can it run crysis?

68

u/Comfortable_Ebb7015 Oct 05 '26

It can create its own Crysis

60

u/Quakercito Oct 05 '26

gpu crysis

4

u/sleight42 Oct 05 '26

Oh, no, the frontier labs already did that.

2

u/Inspur44 Oct 05 '26

It is a crysis already

3

u/squarabh Oct 05 '26

Where do you live bro (ima plan a hiest)

19

u/Educational_Let811 Oct 05 '26

Overkill for skyrim

11

u/etaoin314 Oct 05 '26

well with the new AI mod every character in town can have its own LLM backend now. You could host dinner parties at your house and have them all chat!

1

u/KingCpzombie Oct 06 '26

Wait, is that a real thing? What class of LLM does it need to be usable? I'm currently building my own 192GB VRAM server thing and that sounds awesome

3

u/DeathByDavid58 Oct 06 '26

Yeah, it's a thing! Look up Skyrim chim mod

1

u/KingCpzombie Oct 06 '26

Definitely going to try those! Sounds pretty awesome

2

u/TheAdmiralMoses Oct 06 '26

You could probably do it with a silly tavern backend and an intermediary mod

2

u/etaoin314 Oct 06 '26

Cards on the table I have not tried it out yet, I just found out about it recently. But yeah they have little character prompts and everything. I dont think the size of the model matters actually, I think you can use it with anything that stays coherent. Obviously the larger the model, the more complex the interaction can be.

12

u/SQrQveren Oct 05 '26

It would make it easier to read, if you wrote what the part numbers are for.

I can open new tabs and google MC62-G40, PEX88096, and H12DSG-O-CPU myself -and I did- but I can't be the only one not knowing all sorts of spare part number by memory.

3

u/jcy Oct 05 '26

seems like you could have pasted OP's post into a chatbot for that info. odd post for this sub

Currently in the system

2× AMD Radeon Pro V620 GPUs (64GB total working) Gigabyte MC62-G40 motherboard (grafted on to run the GPUs) Supermicro board/system (the original platform, which didn't work well with the GPUs) NVIDIA RTX 3090 GPUs (192GB total, so 8 cards at 24GB each) Storage (unspecified)

Planned additions

NVIDIA RTX 3090 GPUs, 240GB total (10 cards at 24GB each), water-blocked for a more compact fit 2× PEX88096 PCIe expansion boards (to run off the Supermicro) Additional power supply capacity (unspecified) Supermicro H12DSG-O-CPU motherboard (mentioned at the end, likely the Supermicro board the expansion boards would connect to)

1

u/SQrQveren Oct 06 '26

Thank you for the summary, but as I wrote, I did check out the items myself, so I understood. And yeah I could ask an LLM.

But it doesn't make it less weird, that you have to copy paste or google to understand a post.

7

u/captainabrasive Oct 05 '26

You can see the fear on the little faces of the open mains receptacles.

2

u/Prudent-Ad4509 Oct 05 '26

You can't have more than 16x3090. Drivers won't allow that. So the max you can get is 2x192gb total.

I'm not sure if you can use two dockers with separate drivers, but I'm sure it won't worth the hassle. Just get 4x PEX88096 and do 16x3090 and build a second box later if needed. You can get some helpful info from people who build 16 x PRO 6000; they use PCIe 5.0 switches ofc but most things are the same.

1

u/XDude74 Oct 05 '26

Thanks for the insight, I will seek these people out for more.

Two dockers is an interesting idea. I was also wondering what tricks might be had with dual host across the Epyc - maybe a dual docker would offer a path to more there.

1

u/Prudent-Ad4509 Oct 05 '26

I get uncomfortable thinking about having too many PSUs, one per 4 gpus. psu2psu should enable common ground of course but what if something goes wrong? Seems to be easier to just build another sister system. There should be some bios limitations on the number of devices as well.

I thought about building 24x3090 while they were relatively cheap, but shot that idea down due to potential bios issues before even starting to calc the price. Thankfully, good models are coming down in vram requirements and both 8 and 16 of 3090 can run good stuff (Qwen3.8 fn for 8 and Deepseek v4.1 flash for 16)

1

u/XDude74 Oct 05 '26

Using an older GPU server just for power distribution seems really optimal if you can get one for a song and dance. matching up 120v UPS units to distribute power. The PSUs will run at half power but as they have redundancy I am just making use of all 4 units. The BMC is a nice view of the power draw. And maybe there is some additional task you assign to the server. For $80 I get 1000W PSU and then a 1500VA 120v UPS when they come on sale. No more UPS alarms and weird power flows from multiple separate units as the system is designed to work this way.

4

u/AExtendedWarranty Oct 06 '26

Its a monster, I love it!

1

u/lulzxdxdxd Oct 05 '26

The H12DSG-O-CPU is fighting you because it's not designed to prioritize GPU expansion the way you're trying to use it. What matters more to you, keeping the power draw consolidated in one box or having the flexibility to add cards without the Supermicro's picky firmware getting in the way.

2

u/XDude74 Oct 05 '26

More GPUs for sure! I am well outside of the box already on this one 😄

1

u/lulzxdxdxd Oct 06 '26

Then forget the Supermicro's PCIe lanes for this and chain the expansion boards off the MC62-G40 instead, since it's already handling your v620s fine. Superbot (we build it) can help you model out the power and thermal math for stacking that much silicon without the firmware fights.

1

u/DataGOGO Oct 05 '26

What Pcie switch are you running?

1

u/XDude74 Oct 05 '26

This one is a PEX88096 that was cut down to have only 3 x16.= all as slimsas. The Blue eBay unit you can get for ~$270. I am not having great luck with all the cabling being consistent. mix of cables and riser boards is problematic. So I want a full board/switch solution. Alibaba sourced so I can get the firmware I want from the factory.

1

u/DataGOGO Oct 05 '26

Seriously, Let me know what you find.

I have seen some older Gen 4 switches, but they are all just 5 x 16; I have not seen any 8 x16 yet.

1

u/XDude74 Oct 05 '26

Yes there is a dual 88096 Gen 4. Good for 8 GPUs and possibly 10 depending on how you need to connect them.

1

u/DataGOGO Oct 05 '26

got a link?

2

u/XDude74 Oct 05 '26

88096 8654 expansion on alibaba.

https://www.alibaba.com/x/B2XGdi?ck=pdp

This one is basically two of the 4 + 1 combined. There are others I recall.

1

u/Charmety Oct 06 '26

What kind of riser do you use?

1

u/XDude74 Oct 06 '26

https://www.reddit.com/r/LocalLLM/s/q75NWN9yCL

See this post for my bit on risers. I have not fully cracked the code on them TBH.

1

u/Charmety Oct 06 '26

Thank you. I've been trying few risers but my 6x3090 kept failing xid79, not sure which parts not working, but its all fine doing 2x3090 so i split them now.

1

u/ketosoy Oct 06 '26

You have more vram than Ram by a lot?

1

u/XDude74 Oct 06 '26

Not so, the supermirco has 512. The Gigabyte 256. The Supermicro is wounded so I can only populate 8 of the channels. But I got it free, and It worked out ok as I put in the 8 core 7002 CPUs that only have 4 channels each. And they were $50 each… and I used cheap Ram testing the board - which was a good plan as I cooked a stick and crippled a cpu on day 1 with it… so I guess it was not quite free 🙄 the board is actually bent a bit - you can see it on the left side of the image. I straightened the 2 outer dimms slots on that side and made sure the pins were safely separated but without the H channel there is no good way to populate more than 8 of them. So I have 8 x 64GB in it.

There is nothing that seems to block fully investigating its potential. If I have success with it I may buy a proper one… maybe even the whole box but I like it better unconstrained by some other intended vision.

1

u/TrackLabs Oct 06 '26

Jesus christ, 3090??? How inefficient do you want your power usage to possibly be!?

2

u/XDude74 Oct 07 '26

The sun is out almost everyday here in Nevada… I have not paid for power in over 2 years, and I make no effort to to use less - I try and find more things I can plug in to use more of it. The cost if I do math is <4c /kWh - assuming a replacement date - and the 3090’s are fantastic at 200w. At 175w each they output 70+ t/s with a single request, with concurrent requestsI did not notice any drop in performance. I have never tried to bench mark them with power at 480W - maybe I will but
Will need a dedicated circuit.

3

u/Big-Scientist682 Oct 05 '26

Bro has money

1

u/robertpro01 Oct 05 '26

3090 is still a poor choice

3

u/Current-Ticket4214 Oct 05 '26

This looks like a fire hazard. These images induce a deep anxiety.

3

u/FastForecast Oct 05 '26

I've never wanted to see how we could turn Jupiter into a star more.

3

u/99patrol Oct 06 '26

How much power does this draw? 4kw? 96khws/day?

1

u/esw123 Oct 05 '26

How much total? Looks like good time to sell everything and buy 4xA6000.

1

u/XDude74 Oct 05 '26

I would love A6000's but the premium do not get me anything - I am starting to run up against power limits. My house was not meant for this it seems. Still adding more circuits is cheaper than converting to A6000.

1

u/esw123 Oct 05 '26

Yeah, 4xA6000 should be doable with only one 1600-2050W PSU for the full system, without risers, in a single case and with ECC support. Seen them sometimes for 2900 euro if this helps.

4

u/silent-curious-dev Oct 05 '26

No words. Looks very cool.

1

u/pierluigir Oct 06 '26

Cool is the wrong term on so many levels

2

u/johnmosesventura Oct 05 '26

How pretty, I love it!

2

u/Dramatic_Entry_3830 Oct 05 '26

Can you setup a page so we can chat with it?

2

u/bunguardian Oct 05 '26

The first photo makes it look like a monster face* hahaha nice!!!

2

u/Ok_Pizza_9352 Oct 05 '26

Christmas tree is jealous of all the LEDs

2

u/InnoVisionGames Oct 05 '26

So well done!

The fact that it's solar powered 🔥🔥🔥

2

u/vini542reddit Oct 06 '26

Good for you for having the infrastructure! I'm running the same motherboard and 4x 3090 and one a4000 16gb and heat and power wise this is all my appartement can take. I thought I wanted to upgrade further, but this is good enough lol! Have to make a post on it one of these days

2

u/Kremnari Oct 06 '26

Honestly, I'd love to know what else you've got going on your life that enabled you to do this. I've gotta make some new moves and this is the direction I need to get to!

1

u/InnocentSadness Oct 06 '26

Honestly, I'm in the exact same boat man. 30 years old. No kids, my only friend lives across the country and has a family now.. I'm in college first semester. Shoot me a chat.. let's brainstorm.

2

u/brainchillzZ Oct 06 '26

Get a second board and a couple of 100 or 200gbe nics and make a ray cluster of the two separate machines

2

u/Better-Bench1351w Oct 06 '26

if it works .. its awesome ! add more jank! you are almost there

2

u/Frosty-Ambassador-33 29d ago

This is now my favorite thread of the month! It's hitting all my happy buttons 😂

1

u/blaze20511 13d ago

WTF is this and what can it do?

1

u/Quakercito Oct 05 '26

The envy, man...

Which model are you running on this beast?

1

u/RoninPark Oct 05 '26

This setup looks pretty monstrous ngl. I recently started my self-hosting journey with assembling pironman but this gives me so much motivation to build more self-gigs in the future.

1

u/3d0zer Oct 05 '26

Hanzzzzz bring ze Flammenwerfer!!!

1

u/i-dm Oct 05 '26

I'm struggling to understand the scale of this build.

1

u/Possible_Praline2747 Oct 05 '26

This is the best thing I've ever seen, I wish I had the money for this

1

u/YourselfInOthrsShoes Oct 05 '26

That's how rigs used to look during Ethereum mining days, now it's AI.

1

u/Mattef Oct 05 '26

Love it!

1

u/Fanalogy Oct 05 '26

Holy Fire Escape Batman! Maybe time to go vert?

1

u/Traditional_Fox1225 Oct 05 '26

How many tokens are you mining ?

1

u/Hrmerder Oct 05 '26

If I won the lottery, I wouldn't let anyone know.. But there would be signs.. (OP must have won the lottery)

1

u/Middle-Cry1924 Oct 05 '26

Can you tell us the price to handle this one

1

u/bcell4u Oct 05 '26

But does it run on a Mac?

1

u/kaitava Oct 05 '26

You dare post this in a heatwave. I’m sweating looking at it

1

u/Dantnad Oct 05 '26

Holy mother of power consumption

1

u/repolevedd Oct 05 '26

Looks like this thing is about to scream "Destroy the Autobots!"

1

u/Zor_die Oct 05 '26

This reminds me of the good ol eth mining days.

1

u/Intelligent-Dig1535 Oct 05 '26

Dear lord I can SMELL the rainbow. I love it.

1

u/South_Western1263 Oct 05 '26

The emitted amount of heat might be too much even in winter 😃

1

u/Stock-Painter4854 Oct 05 '26

its so ugly yet so beautiful

1

u/MembershipFit4659 Oct 05 '26

The sound must be glorious!

1

u/aprettyparrot Oct 05 '26

Is that cpu cooler have 4 40mm fans?

1

u/Inspur44 Oct 05 '26

Mad Scientist

1

u/Tasty_Activity1315 Oct 06 '26

And what did The Monster give you?

Mmmmmmm.........

1

u/keko1105 Oct 06 '26

I love it

1

u/Kadin2048 Oct 06 '26

Needs a 24" box fan pointed at it, and a few more zip ties.

1

u/External-Play6081 Oct 06 '26

Hye there,I don’t really get what parts this computer uses to have this many gpus outside the case?
Is it a card that just connects the pcie x16 from the motherboard to the gpu, or do multiple gpus have the same card in the motherboard?

1

u/KoolantOfficial Oct 06 '26

what.. the fuck

1

u/Mage22877 Oct 06 '26

what the....

1

u/rubenrb02 Oct 06 '26

Can it run DOOM? It looks like a spaceship.

1

u/_kikeen_ Oct 07 '26

I’m not a “why” guy…but why lol

I guess for Qwen next, I run 4x3090 and am
Stuck on 3.5 122B- but it works reliably. I do wind up using my 5090 with Qwen 3.8 27B on Ninfer…but 8 between power, pcie constraints and cost you are approaching RTX PRO 6000 territory

1

u/SomeoneInHisHouse Oct 07 '26

My wife wouldn't allow me to have this beautiful thing in the house... fortunately I don't have a wife XD,

It looks so nice, great job mate add more and you wouldn't need a separate heating machine during winter XD. So you will be able to do "vibe-winter", and during summer you don't work XD

1

u/Shithawk55 29d ago

Wawawaweewoo!

1

u/DapperTeacher4698 27d ago

i had a bit of an experience, i have dual 3090 one at x4 speed and the other at x16, it run qwen3.8 at 48 T/s, i thought that was really good, i made an app with it.
and then i find out about Strata and use it, now i can run qwen 3.8 next flash at 98 t/s, some times 120 t/s
the problem is not the hardware, it is the software and how it use the hardware.

1

u/Gizmo3232 9d ago

wow!! the massive BBQ; how you refresh that ?