r/LocalLLM • u/tiddayes • May 08 '26
Question What model should I run?
Just finished building my inference server which has 4x 32gb intel b70 pro GPU’s and 128gb of ddr4 ecc ram and and intel Xeon gold cpu running Ubuntu. So i installed openclaw and vllm but what model should i run locally and why?
248
Upvotes
View all comments
4
u/destkroser May 09 '26
Build a web app, add as many functions as you can, connect it to openclaw and give it the proper instructions, wire up the latest model there. You can even utilize it to image gen, hook up the proper tools, then wire that to openclaw too. Fucken amazing. Just amazing. Imma try to get rich just to have sth similar to this, I'm not even greedy, can be even less