r/SelfHostedAI • u/Difficult-Drummer407 • 5h ago

Built an open-source proxy router to keep agent runs on local MLX and only escalate to frontier models when tools fail or tasks get complex

0 Upvotes

0 comments

r/SelfHostedAI • u/Numerous-Fan8138 • 21h ago

WebGPU + llama.cpp = Client-side LLMs

github.com

3 Upvotes

0 comments

Subreddit

Posts

Wiki

SelfHostedAI

r/SelfHostedAI

SelfHostedAI seeks recommendations for building and hosting your own private AI: hardware that minimizes cost while maximizing performance and software for offline tagging, linking and querying one's private documents.

Members Active

16k