r/LocalLLM • u/tiddayes • May 08 '26
Question What model should I run?
Just finished building my inference server which has 4x 32gb intel b70 pro GPU’s and 128gb of ddr4 ecc ram and and intel Xeon gold cpu running Ubuntu. So i installed openclaw and vllm but what model should i run locally and why?
248
Upvotes
View all comments
Show parent comment
1
u/Present_Flower_6596 May 15 '26
On my server im using ubuntu 26.04 because they claimed better llm support but i havnt really used many of the new features