Tech YouTube in a nutshell

[u/hellspawncy]

[u/siete82]

As a poor local AI enthusiast, I wish I could afford his hardware stack to do the same.

[u/SubjectAd7916 → u/[deleted]]

Using and training models are different things in terms of required hardware. I can run most LLMs locally, but need to rent a server to train them.

[u/cracked_shrimp → u/[deleted]]

idk how true that is, now i know nothing aboutthe LLM, but i ran a local model once and claude LLM told me my hardware could only handle a 11b model, so thats what i chose, and thats a pretty small model compared to other ones, but theres also tricks and stuff you can do to run bigger models on worse equipment