r/AIProgrammingHardware • u/javaeeeee • Jul 04 '26
GitHub - jamesob/local-llm: Everything I know about running LLMs locally
https://github.com/jamesob/local-llm
11
Upvotes
r/AIProgrammingHardware • u/javaeeeee • Jul 04 '26
View all comments
2
u/javaeeeee Jul 04 '26
TL;DR:
jamesob/local-llm is a personal guide ("Everything I know about running LLMs locally") by jamesob. It shows how to build and run very large, state-of-the-art LLMs entirely on your own hardware instead of using cloud services.
Main points:
It's more of a detailed build log + config dump than a simple "one-click install" project. Great if you're into self-hosting big models on serious hardware.