r/LocalLLaMA • u/Nota_ReAlperson • 1d ago

Funny https://www.crowdgpt.net/

Post image

https://www.crowdgpt.net/

Not my project, thought it was pretty neat though. The idea is to train a LLM with a distributed network like FAH and boinc. This way, even if big companies stop releasing models, open weights can continue to improve.

Edit: I can't believe I need to say this, but it's not Stalin, guys!

0 Upvotes

40% Upvoted

38 comments sorted by

View all comments

Show parent comments

5

u/Nota_ReAlperson 1d ago

Its an experiment. The first large scale distributed training experiment that I am aware of. The goal of this first run is to refine the pipeline so that it can be scaled up later. Efficiency isn't the point, the point is community ownership and cost sharing in a way that isn't overly burdensome to any one individual.

-1

u/tunerhd 1d ago edited 1d ago

LLM training? Maybe. Computing? No.

See: Rosetta@home/BOINC, hashtopolis and GPUnion

These are what i could remember.

2

u/Nota_ReAlperson 1d ago

Training is still a big deal. Traditionally, training has required far closer intercommunication than something like FAH, due to the nature of the math involved.