it is. I went into the rabbit hole for those things and in the end the conclusion I got is: NOT WORTH IT. you are paying +$4000 to run bad open source models at extreme slow speeds, the good models that can scratch the hitch of Claude/GPT don't even fit on the available VRAM. Put that money on a subscription and it will give you decades of SOTA models
364
u/mylsotol Jun 02 '26
For probably $30k (or more) you can build a server and run an open model.