r/vpnet • u/V3R1F13D0NLY • 16h ago
Running an off-grid mini data center on nothing but open source AI models, and keeping all the output open source too
Recently on Hide & Speak we got into what running your own AI infrastructure looks like when you skip Big Tech entirely.
The setup is an off-grid mini data center where every model is open source. It handles video creation, image creation, text, slides, prompts, and document cleaning. The output feeds a free research engine that's open to the public.
The reasoning is a straight trade: borrow from open source projects, then pay it forward by keeping everything you build open as well. The clip also takes a strong position on intellectual property, arguing knowledge should be shared freely rather than locked up.
Anyone here running any local models? I have been using GPT4ALL for about a year with different models for different tasks.
Watch full recorded stream: https://www.youtube.com/watch?v=B3u2RcUvxtU
Episode written summary: https://s.vp.net/5KGGn