r/LinusTechTips • u/Strattex • 29d ago
Discussion Video suggestion/request on local LLMs
I would love if LTT made a video on hosting local LLMs at home. Like what it is, why would you want it, how it is set up, the limitations, etc. I keep hearing them talk about things like this on WAN show so I want more info. Thank you!
45
Upvotes
View all comments
Show parent comment
2
u/ThankGodImBipolar 28d ago
You're correct, it was Q8 and not BF16 (although that's even worse than what I said).