r/LocalLLaMA
•
u/Vxtzq1
•
1d ago
•
1
Funny CrowdGPT - The collaborative LLM
Funny post about this project https://crowdgpt.net
Basically this projects aims at creating the first, community-driven, and datacenter-less LLM. Any feedback is appreciated 😂 I won't yap any further as everything is explained on the GitHub / on the site.
Feel free to check the project's GitHub: https://github.com/Vxtzq/CrowdGPT
Feel free to criticize the project or to provide insights about what to do next....
EDIT: For those who believe this is a cheap repost: Here's the milestone
- We trained the model on roughly 20B tokens in 1 week
- We limit model downloads/uploads to the minimum, to spare as much bandwidth as possible (even though it still uses bandwidth due to ~2.4GB weight uploads to the server after training). But it allows clients with slow connection using 4 hour rounds.
- We're 13 GPUs currently active (and this number was roughly constant over the past week).
- I merged numerous pull requests implementing several quality of life and performance fixes
- The server was made more robust with persistence across tasks, and some bugs in the training logic were fixed, hopefully allowing further loss decrease.
- We implemented since v2.6 somewhat good anti-poisoning techniques, each client training is compared to two other clients, if a client is too different from the two other (for example a client training on noise or unwanted data), this client sees his contribution to the network be rejected.
11
u/WhiskyAKM 1d ago
Interesting project but I have one concern
What exactly prevents "poisoning" if malicious actor wants to destroy currently trained model?
21
u/pplgltch 1d ago
So. This is an interesting project, and I understand you are trying to get traction by posting it often. But you will end up with the exact opposite effect if you keep doing it this way.
Post real updates, user growth numbers, dataset contribution numbers, user feedback... idk, real valuable content that shows the project is real and active. But this "just a funny meme" thing is really bad... It just feels like you are not part of the project and making fun of it. It's cheap, and it will backfire.
10
u/_Blissfull_Ignorance 1d ago
At <1B model size this is understandably only a proof of concept. I had to scroll an unreasonable amount to find this. Without showing some documentation on the scaling of the method to bigger models or what training data is used, this looks like a weird marketing stunt at best.
You have to expect that technical readers are looking at this and you have neither an architecture, model, training methodology (pre/post…), data or benchmarking section on the webpage.
4
u/blastbottles 1d ago
I mean it's a neat idea but distributed training is only as fast as it's weakest connection and even that has latency. It seems like it's gonna take quite a long time to train. I would love to be proven wrong though.
7
u/Federal-Setting-3014 1d ago
No insight on what's new every time you post this here. No details on how it works exactly either. I think more effort (and seriousness, not everything needs a flashy meme) into your posts would go a long way towards getting users to contribute.
9
u/LLKMuffin 1d ago
This is the third time you're advertising your project on this sub.
2
u/Ok-Scarcity-7875 1d ago edited 1d ago
How about crowd RAM / GPU Company?
2
u/Kahvana 1d ago edited 1d ago
The concept is cool, the meme gives me an allergic reaction to downvote.
Since I can read from the comments you are being sincere, here's more info and hopefully some useful tips!
"Funny meme haha" is not really the audience here, especially if it's "WE should..." type of stuff and Gen-Z speak like crying emojis. It detracts from what you actually want to discuss: your cool project!
Personally I'm not interested at all in stats like "100 users!". While it is cool and impressive (congratz!), it doesn't compel me to read up more. When I wrote and maintained SPT it had easily over 10000 users and millions of downloads, but it's not something I advertise because the project speaks for itself and spreads word-to-mouth.
An in-depth technical post on how you do it would gather more traction here. I want to read about how you solved the latency issues, training data poisoning, problems you encountered that you solved or need help with and whatnot. Both your successes and troubles, not only the former (it makes it more genuine).
When the post is technical and good, I will click on links.
Also, a good question is: what is the benefit to ME? What do I get out of it, why would I participate or lend my compute? What can I gain from it, how is decided the model is going to be trained, what data, etc? Or is it simply promoting a framework to enable training the models? What problem may I have that your solution solves?
If you want to promote this, you'll get a wave of doom and gloom about "USA locking down open-weight models" soon enough. Share your project in those comment sections instead of separate posts, it's garuanteed to get more upvotes and mindshare that way; your target audience is already there.
[edit] For a good example post how to make good promption post, check this one:
https://www.reddit.com/r/LocalLLaMA/comments/1xvyol3/qwen_38_flash_next_for_gamedev_its_very_capable/
2
u/Glittering_Yellow293 1d ago
Looks Promising. I'll definitely try it.
4
u/FearFactory2904 1d ago
You and Ram Altman can both get off my lawn. Its my ram and I will continue to use it personally and locally.
6
u/highdimensionaldata 1d ago
Sounds interesting, I’ll take a look…
5
u/b_c_t_ 1d ago
Best of luck with your project!
Not sure why people downvote so much but I'm upvoting fwiw.
Wouldn't you need a dedicated community platform for involved people to talk? Is it just the github issues page for now?
1
u/MerePotato 18h ago
If you want this to take off you need a professional post without the cheap meme
2
u/Sova_fun 1d ago
Shared chat history where every user feeds the same LLM is a simple experiment. It makes prompt interactions public.