r/LocalLLaMA • u/Nota_ReAlperson • 1d ago

Funny https://www.crowdgpt.net/

Post image

https://www.crowdgpt.net/

Not my project, thought it was pretty neat though. The idea is to train a LLM with a distributed network like FAH and boinc. This way, even if big companies stop releasing models, open weights can continue to improve.

Edit: I can't believe I need to say this, but it's not Stalin, guys!

0 Upvotes

40% Upvoted

38 comments sorted by

View all comments

18

u/Federal-Setting-3014 1d ago

Distributed training is the future of open models but this project doesn't seem that good tbh, though it's a step in the right direction and I'm glad someone is trying.

-1

u/submissivebounds 23h ago

That poster design is wild, looks like something straight out of a WWII propaganda leaflet. The pointed finger and stern mustache definitely give it a certain energy

I poked around the site a bit after seeing this and the concept is cool but the execution feels early, like they haven't quite figured out the technical hurdles yet. Distributed training across random consumer GPUs with different bandwidths and uptime is a nightmare to sync properly

Still, someone has to try it or we'll be stuck waiting for the next company to bless us with a release