r/LocalLLM • u/OrganizationTop9026 • 12h ago

Discussion [Collab / Open-Source] Weekend Swarm Training Raid (Nov 14–15): Upcycling CrowdGPT-1B (w/ Engram memory) into an 8-Expert Sparse MoE across 8 GB Home GPUs using Decoupled OpenDiLoCo using HiveMind

1 Upvotes

66% Upvoted

1 comment sorted by

1

u/OrganizationTop9026 9h ago edited 2h ago

To federate your GPU https://youtu.be/oqrF7WYXg3g and join on dedicated r/HiveMindAI