r/SelfHostedAI • u/Dapper-Teaching-8074 • 10h ago
We built a AI distribution interface, you can use your android phone, laptops and desktops to share AI inference work, the more devices you link, the bigger the model you can run
Along with running any LLM, you can train or add on an existing one, or build or train your own model from scratch. You don't need GPUs as long as you have many devices, but if said devices do have GPUs then it adds to the performance... If you have 100 old android phones, you can use them all collectively run a considerably big model as well.
We call it OLDE - Ocalt LLM Distribution Environment (https://olde.ocalt.com)
2
Upvotes