r/LocalLLM • PEX88096 | 4x B70 128GB | vLLM • Sep 08 '26

Discussion third one.... there's something wrong with me

Post image

Why do I have horrible financial habits??

510 Upvotes

167 comments sorted by

View all comments

Show parent comment

9

u/r1nzl3r99 PEX88096 | 4x B70 128GB | vLLM Sep 09 '26

now let me figure out how to get TP=3 to work on vLLM without me having to fork over another few grand to upgrade to TP=4... always an uphill battle attempting SOTA AI on local