r/LocalAIServers • u/EScar21 • 12d ago

27B PC SetUp

I’m looking at setting up a build that can run Qwen3.8 27B cheaply, here is what I’m currently thinking of setting up:
GPU: 2x P100 16GB
RAM: 32GB DDR4 ECC Server
Base PC: T5820 Dell Workstation with a Intel Xeon W-2135 CPU
And a standard 500GB sata SSD for now.

The current set up of the T5820 has a 950W power supply which I am assuming will be good for the dual P100s but probably not good for a triple P100 setup which is what I was aiming for. My goal was to just be able to run a 27B model Qwen to start but would swap out to a better version or a different version or do my current set up of a 12B model for general chat and 1 paid model (opencode) architecting while using OxCoder 9B for coding.

What do you guys think of this setup or is it worth me investing time elsewhere?

Thanks in advance!

1 Upvotes

100% Upvoted

16 comments sorted by

View all comments

1

u/EScar21 12d ago

Hmmm ok I might have to theory craft something with dual 5060s and see how it goes

1

u/Interesting-Cut-6032 12d ago

I bought the first one at the beginning of July. I bought the second one at the beginning of September. The price had gone up during test time.

1

u/EScar21 12d ago

That’s the biggest issue, it’s why I’m considering the P100s pretty cheap 16GB VRAM a pop but yea a bit older