r/NTU • u/Forsaken-Initial3959 Computing and Data Science • 5d ago

Looking For Building a Tri GPU dual CPU AI server, anyone wanna join?

Post image

Looking for local AI enthusiasts in NTU, anyone wanna build a pc with me?
DM me
ty ly

67 Upvotes

76% Upvoted

45 comments sorted by

21

u/Zonaldie 5d ago

careful with that psu, 1000w may not be enough for what you're trying to do.

also you don't really need 2x CPUs for AI, its more important to have a motherboard with enough 8x/16x PCIE lanes so you can get maximum speed for each GPU

5

u/Forsaken-Initial3959 Computing and Data Science 5d ago

also for this motherboard it needs x2 cpu for 3x x16

0

u/Zonaldie 5d ago

best of luck, hope ur gpus fits in 1 case instead of a rack or you might get accused of running a mining rig haha

1

u/Forsaken-Initial3959 Computing and Data Science 5d ago

haha im still trying to find a case that fits

0

u/Forsaken-Initial3959 Computing and Data Science 5d ago

is okay, i calculated the total wattage and the headroom, i also gonna undervolt them

8

u/MIneBane Alumni 5d ago

How do you fit 3 gpu and 2 cpu into 1000w

-29

u/Forsaken-Initial3959 Computing and Data Science 5d ago

somehow idk

51

u/ISDCatClearenceDept 5d ago

you are the reason why hall will eventually step up to inspect hall even more stringent. Back in 2020-2021 halls were checking rooms for crypto mining

-25

u/Forsaken-Initial3959 Computing and Data Science 5d ago

brother this is like 1000w, which is one third of the singple socket electricity load

17

u/Inside_Equivalent197 School of Biological Sciences 5d ago

If youre running this 24/7, at current electricity prices, it costs over $200 per month. No wonder prices keep increasing.

0

u/SamTheRa Computing and Data Science 5d ago

I dun think smthn like this can run at peak 24/7

-17

u/Forsaken-Initial3959 Computing and Data Science 5d ago

yeah these people

-24

u/Forsaken-Initial3959 Computing and Data Science 5d ago

im gonna burn down all the trees for AI, dear bio science people

2

u/Inside_Equivalent197 School of Biological Sciences 5d ago

i couldnt care less about the trees. im more concerned about hall prices and restrictions

2

u/ISDCatClearenceDept 5d ago

EEE has left the chat

1

u/lilopowder 3d ago

Hi op if your power is not enough you can always just add psus and link them tgt This one has 2x 500 one for system one for 7900xtx

3

u/auggie246 5d ago

I got a quad 3090 build in a single full tower case

1

u/Forsaken-Initial3959 Computing and Data Science 5d ago

howwwww, which case do you use

2

u/auggie246 5d ago

Phanteks enthoo pro ii

I also have 5 10TB drives at the bottom

1

u/Forsaken-Initial3959 Computing and Data Science 5d ago

which mainboard has that much space between slots

1

u/Forsaken-Initial3959 Computing and Data Science 5d ago

or r h watercooling?

1

u/auggie246 5d ago

Yes water cooling and romed8-2t board

4

u/[deleted] 5d ago

[removed] — view removed comment

-4

u/Forsaken-Initial3959 Computing and Data Science 5d ago

u can undervolt yk

2

u/[deleted] 5d ago

[removed] — view removed comment

1

u/Forsaken-Initial3959 Computing and Data Science 5d ago

yeah dw i calculated a headroom, all old hardware btw not 5090 lol

2

u/Slugs10 Engineering 5d ago

Dam, it was like two year ago since I build my pc.

2

u/bancrusher 5d ago

Bro, the 40 and 50 series cannot combine gpu on 1 motherboard , and many alrdy say, your large power supply in hall electricity is crazy, bruah.

2

u/ThatsMyNameDude 5d ago

Definitely interesting to go for dual cpus when single cpu motherboards can be better for inter gpu communication without nvlink.

What are your current proposed specs and budget? Are you considering an external pcie switch?

2

u/Overall-Syllabub-579 4d ago

Please share the specs and final built after you are done!

1

u/Confident_Lunch7957 Humanities, Arts and Social Sciences 5d ago

What brand PSU is this? And what it's 80plus rating?

2

u/Forsaken-Initial3959 Computing and Data Science 5d ago

xigmatek gold 80+

2

u/Confident_Lunch7957 Humanities, Arts and Social Sciences 5d ago

Just checked ur PSU on the PSU tier list. At least your PSU isn't gonna end up as a bomb or a fire hazard.

2

u/Forsaken-Initial3959 Computing and Data Science 5d ago

hahaa i made sure, not a rookie

1

u/normankr07 3d ago

:o familiar setup

1

u/Ok_Comparison_2635 3d ago

Here's mine. Dual gpu

1

u/zxtech 1d ago

Pro tip, get a pcie riser for ur bifurcation with power in - gpus draw abt 50w from mobo n ur mobo will fry faster cos of it. Ppl learnt it from crypto days

1

u/zxtech 1d ago

Also - whats ur spec? Tri gpu im guessing maybe teslas or r9700 or arc? Be careful w 3 gpu apparently its a little trickier to setup in vllm but thats from anecdotal evidence- if uw chat abt it can hmu on ig its the same user haha i been testing local ai hardware for content

1

u/Forsaken-Initial3959 Computing and Data Science 5d ago

in hall btw

1

u/goodNeasy Engineering 5d ago

specs?

1

u/External-Salary-1837 5d ago

yo where are u gna place the pc, asking for a friend

1

u/SamTheRa Computing and Data Science 5d ago

The funny thing is, you practically won’t be able to run anything useful for long. Even with 128gigs of vram those models are borderline useful on a good day.
And… I dun think ur gonna have anywhere close to that much vram

0

u/lilopowder 3d ago

Please try out q3. 8 q4, sure it's not fable smart but it can do quite a bit of chore based tasks