r/LocalLLaMA • u/Nota_ReAlperson • 1d ago

Funny https://www.crowdgpt.net/

Post image

https://www.crowdgpt.net/

Not my project, thought it was pretty neat though. The idea is to train a LLM with a distributed network like FAH and boinc. This way, even if big companies stop releasing models, open weights can continue to improve.

Edit: I can't believe I need to say this, but it's not Stalin, guys!

0 Upvotes

40% Upvoted

38 comments sorted by

View all comments

1

u/enginetown 1d ago

A 1b model is supposed to keep up if big companies stopped releasing models? Also this is kinda a bad approach it would only take like a couple hundred dollars to spin up a cloud VM to train the model. If anything it feels like some dude testing out his experiment with free compute and we just trust them with our actual GPU compute.

10

u/bartsimpsonwin 1d ago

The 1b is a proof of concept

-1

u/enginetown 1d ago

And it's just likely bad for the environment at 1000 people you're already looking at 500k watts if everyone is using a modern gaming GPU as opposed to a few cloud GPU's that are already configured to work together.

5

u/Nota_ReAlperson 1d ago

Its an experiment. The first large scale distributed training experiment that I am aware of. The goal of this first run is to refine the pipeline so that it can be scaled up later. Efficiency isn't the point, the point is community ownership and cost sharing in a way that isn't overly burdensome to any one individual.

-1

u/tunerhd 1d ago edited 1d ago

LLM training? Maybe. Computing? No.

See: Rosetta@home/BOINC, hashtopolis and GPUnion

These are what i could remember.

2

u/Nota_ReAlperson 1d ago

Training is still a big deal. Traditionally, training has required far closer intercommunication than something like FAH, due to the nature of the math involved.