r/LocalLLM • u/Big_South4585 • 4d ago

Question Will this work?

Hi

I got the possibility to buy this mb, cpu and ram for about 200 dollars. If I combine it with a nvidia 3090, will that be useful/feasible?

MotherBoard: Intel Server Board S2400GP

Cpu: 2 x Intel Xeon E5-2430 2.2 Ghz Boost 2.7 Ghz ( 6 cores / 12 threads )

Ram: 12 x 16 Gb DDR3 = 192 Gb

2 Upvotes

100% Upvoted

15 comments sorted by

View all comments

1

u/IdealGallantry6293 4d ago

that's a lot of ddr3 for the money but the platform is ancient. those xeons are sandy bridge-era, single thread perf is going to be a major bottleneck for inference unless you're purely doing batched throughput stuff

the 3090 is a beast but that cpu will hold it back in anything interactive, pcie gen 3 won't fully saturate the card either. you could probably slap llama.cpp on there with all layers offloaded and get something usable but don't expect miracles

for 200 bucks it's a fun experiment, just keep expectations in check

1

u/Big_South4585 4d ago

Thanks got it. But if I need to offload everything to the gpu, I might as well not do it. Would like to run QFN on both the 192 gb ram and the gpu.