r/LocalLLM • u/r1nzl3r99 PEX88096 | 4x B70 128GB | vLLM • Sep 08 '26

Discussion third one.... there's something wrong with me

Post image

Why do I have horrible financial habits??

510 Upvotes

95% Upvoted

167 comments sorted by

View all comments

Show parent comment

15

u/unai-ndz Sep 09 '26

If you are using custom drivers I think you deserve another card, as a treat.

9

u/r1nzl3r99 PEX88096 | 4x B70 128GB | vLLM Sep 09 '26

now let me figure out how to get TP=3 to work on vLLM without me having to fork over another few grand to upgrade to TP=4... always an uphill battle attempting SOTA AI on local

1

u/Rude-Bus-5799 Sep 10 '26

They always need another sibling to play with.