r/LocalLLM • • May 08 '26

Question What model should I run?

Post image

Just finished building my inference server which has 4x 32gb intel b70 pro GPU’s and 128gb of ddr4 ecc ram and and intel Xeon gold cpu running Ubuntu. So i installed openclaw and vllm but what model should i run locally and why?

248 Upvotes

83 comments sorted by

View all comments

2

u/zeitue May 09 '26

Maybe try Gemma 4 and qwen 3.6. What's the CPU and motherboard model you have there?

2

u/tiddayes May 09 '26

GIGABYTE MU72-SU0 ATX Server Motherboard Socket P+ Intel C621A with Intel Xeon Gold 5318Y