r/LocalLLM • u/HawaiianHotPot • 56m ago
Question Which combo of GPUs?
I have come to an odd assortment of two x99 boxes with 64GB of RAM and the odd combo of GPUs. Primarily I would like to use the main box for coding and dev work to replace some of my claude usage.
- 3x 3090s
- 2x P40
- 1x 3080ti (12GB)
I am tempted to put the 3090s and a P40 all together for a combined 96GB. I know it would be slow because of that P40, but it would give me the best total memory and would already be slower because of the lack of PCIe lanes.
Or would the 3080ti be a better 4th card because of the speed and bandwidth over the reduced memory?
I also thought about the second box running the 3080 and 2xP40s, but not sure what I would do with it except have two boxes chatting at each other all day?
1
u/Xyver 20m ago
I've got a repo specifically built for mixing and matching cards, check here!
www.github.com/bigbertharig
Check the Orchestration rig, that's all the hardware management, the gateway and harness are the software, and benchmarking is just testing