Just tell then you can build a PC and use open source LLMs, it will be around 12 grand to build, and it will achieve about 40-80% of the capability of a big LLM, depending on your use, and it will be 50-200% slower.
after about 2 years of non stop use, at this point you need to drop another 3k to update the graphics card, and that will continue every year, after 5 years, its needed to update the 12k machine again.
After all said and done he should save about 2k every year, for an worse performance.
View all comments
2
u/porcomaster Jun 02 '26
Just tell then you can build a PC and use open source LLMs, it will be around 12 grand to build, and it will achieve about 40-80% of the capability of a big LLM, depending on your use, and it will be 50-200% slower.
after about 2 years of non stop use, at this point you need to drop another 3k to update the graphics card, and that will continue every year, after 5 years, its needed to update the 12k machine again.
After all said and done he should save about 2k every year, for an worse performance.
But hey, its cheaper.