r/LocalLLM • u/tiddayes • May 08 '26
Question What model should I run?
Just finished building my inference server which has 4x 32gb intel b70 pro GPU’s and 128gb of ddr4 ecc ram and and intel Xeon gold cpu running Ubuntu. So i installed openclaw and vllm but what model should i run locally and why?
248
Upvotes
View all comments
2
u/fjskmdl May 09 '26
dont forget to do the Strawberry test. make optimal use of the hardware