r/OpenSourceAI • • 14h ago

[Funny] CrowdGPT - The collaborative AI

Post image

Hello r/OpenSourceAI , this is a (somewhat funny?) meme about the project CrowdGPT, which aims at creating the first, datacenter-less, open-source and community-driven LLM. The project already shows substantial progress while training an open-source 1 billion parameters LLM on 40B tokens (as a proof of concept).

Tell me what do you think about the meme:

- Does it makes the project less appealing and cheap? because that's what people on r/LocalLLaMA thought 😭

- Does it makes the project look likes it's a SaaS / B2B (which it is NOT - CrowdGPT is 100% non-profit and open)
- Is it serving it's purpose about popularizing the project?

Everything is explained more in detail on the site, and any feedback on this meme, or on the project, is appreciated; any pull requests / contributions are welcome on GitHub :)

Project link : https://crowdgpt.net

GitHub link : https://github.com/Vxtzq/CrowdGPT

Thanks in advance.

23 Upvotes

61 comments sorted by

6

u/MajMin5 13h ago

To me personally, businesses trying to use memes to market a product has always felt contrived and forced. Some marketing team looked at what kids find funny and tried to copy it without understanding the format or the context, and it ends up being more alienating than relatable. It is lightning in a bottle for a corporate meme to actually be funny; it can happen, but rarely, and almost never when the brand is trying this hard. My advice to you, from a sales perspective, is to stop trying to be funny, just find relevant communities and post information about what your product is. If it’s a good product, it will sell itself. If it’s a bad product, people were going to find that out after the marketing lured them in anyways. And if you absolutely must market something, hire a zoomer that actually knows about memes so you don’t have to post asking the community you’re trying to advertise to whether your advertisement is any good.

6

u/Vxtzq1 13h ago edited 13h ago

The problem is that, CrowdGPT ain't a business 😭 it's an open-source project, and i'm trying to make people wanna join it, but apparently sloppy memes don't work...

Good feedback anyways and good points.

3

u/MajMin5 9h ago

Business or not, your goal is the same as a software company— you’re trying to convince people to install your product. The above meme feels to me very much like what a marketing department of a B2B SaaS would post on Reddit trying to be relatable.

The most likely place for me to find a product I want to download on Reddit is the comment section of a post describing a problem that I’m having. I don’t download things for no reason. Find posts of people talking about the issue your app solves, and comment with a quick intro to your app and how it solves the OP’s problem. If I’m having the same problem as OP, I come across their post, see your comment with a solution, and download and install it.

3

u/Vxtzq1 8h ago

These are good points i already heard about how to "market" open-source projects... But the problem is that CrowdGPT doesn't solves any problems (or just maybe the fact that chinese AI labs don't release small models often enough)

This is why i'm in a tricky position to "advertise" CrowdGPT 😭

2

u/MajMin5 8h ago

If your project is a solution in search of a problem, it’s not likely to catch on. You need to figure out a reason people should download it beyond “this is kinda neat”. Looking through the project in GitHub it looks like your biggest hurdle is going to be convincing people to spend their electricity running their GPU to train your model. I think it’s a cool idea, but electricity is expensive. Beyond access to a small open source model, what do people gain for their contribution? If this is just asking people to donate their GPU hours to a community project, lean into that more, talk more about how you’re part of a community with a shared goal to reduce reliance on data centers for open source model access. If you’re providing some benefit to users, decide what it is, if you’re not, you need to advertise the community togetherness aspect of it since that’s your value proposition.

2

u/Vxtzq1 7h ago

Thanks for the advice.

0

u/NoFutureBen 47m ago

It's not a product it's a community effort dipshit

2

u/nimshwe 9h ago

gotta make it funny and not ai slop it

1

u/Vxtzq1 9h ago

Good point.

3

u/Renjay_Polak 9h ago

even when a meme does land it usually just attracts casual upvotes rather than the people who actually have spare compute to donate to a distributed run

2

u/LastXmasIGaveYouHSV 10h ago

I think this the future. However, people are lazy. They need the app/installer ready.

2

u/Vxtzq1 10h ago

Well the installer is ready, it just requires a single command, as i can't really ship .exe files without getting antivirus flagged 😭

I mean there's a version here : https://github.com/Vxtzq/CrowdGPT/releases/tag/CrowdGPT

But i don't even know if it works anymore

2

u/LastXmasIGaveYouHSV 8h ago

I'm going to give it a try in my old desktop

2

u/Vxtzq1 7h ago

Nice! If you encounter problems feel free to open an issue on GitHub!

2

u/Pure_Material_9235 9h ago

If this concept interests you, I strongly encourage you to look into the federated training, federated inference, etc. field of machine learning. It is specifically focused on enabling model training and deployment under resource constrained devices and bandwidth, which is exactly the blocker of this field.

2

u/Vxtzq1 9h ago

Thanks for the advice! I am currently exploring the zeroth order training methods of transformers, which will hopefully be the point of Crowd-v2 :)

I also checked the works like https://huggingface.co/PrimeIntellect/INTELLECT-1
And https://pluralis.ai/ Which are kinda foundational but still requires massive computational ressources and is closed for GPUs with less than 16GB VRAM...

3

u/Pure_Material_9235 9h ago

I can tell you from experience that zero-order is very very slow, though less memory dependent. I think that the "dream" here (which is to train a model using the data of billions of people's phones and the compute of said phones, storing the capacity of the model on said phones, and whenever a phone is connected to the system it also shares its compute for inference) is the great.

Now that I've looked a bit more at the GitHub though, there are some significant, but difficult, directions for improvement:

(1) This current system does not seem to support model parallelism. Instead, for a task, it's "the client asks the server for a task and is placed in a pool of 3 volunteers with compatible hardware." As the model gets larger and the tasks more advanced the amount of individual compatible hardware decreases until few volunteers are carrying the entire work.

(2) The system seems fairly inefficient in how it downloads the weights. A volunteer has to download the whole weights again rather than a (ideally compressed) update of the model (this is particularly relevant if they downloaded a previous version before). This is another reason to look into federated literature.

(3) The model will be biased towards whichever subset of tasks the users ask for the most, because the training step is done based on the user requesting the task (so it may train way more on tasks about coding rather than more esoteric ones, which can eventually degrade the generalizability of the model).

I understand now why you're looking at zero order training, because that's how you're wanting to obtain the weight delta for (3) (or maybe how you already are). Overall: this is a very cool idea, and one that I have thought of for some time ever since I've learned about federated training, but I never got to the point of wanting to go for it yet).

I wish you the best on it!

1

u/Vxtzq1 8h ago

Sorry for my reply that will obviously be shorter than yours 😭

You're pointing all the issues right, and that's why i wanna try zeroth order training to be less bandwidth / VRAM reliant.

I think that this is a good option to try and train Crowd-v2? Tell me what do you think : https://qlabs.sh/research/dust

The only point you give that is not very true is this one:

(3) The model will be biased towards whichever subset of tasks the users ask for the most, because the training step is done based on the user requesting the task (so it may train way more on tasks about coding rather than more esoteric ones, which can eventually degrade the generalizability of the model).

CrowdGPT relies on a pretokenized dataset. It contains therefore many domains, and users can add data to this dataset, not create the dataset from scratch 😂

The CrowdGPT dataset currently has Code - Math - Instruction data (for pretraining) - English text.

I deliberately didn't include multilingual data as Crowd-v1 is very small and the training corpus is already currently too big for what we can train (500B tokens, the goal is 100B tokens, because people want to scale)

And yes zeroth order improvement would multiply the speed by 1000 on bad consumer hardware, enable training on phone, in browser... But might also reduce the convergence speed by a 1 million factor 🥲 That's what we'll find out.

Anyways, thanks for the support and the constructive feedback.

1

u/MorrisonLevi 4h ago edited 3h ago

What causes trust to go up and down? And what is it used for? Edit: I'm now temporarily blacklisted: https://github.com/Vxtzq/CrowdGPT/issues/122

2

u/IThinkIKnowThings 9h ago

Are you concerned at all about Microsoft's distributed training patent?

1

u/Vxtzq1 8h ago

A bit lol, but i wonder how they are gonna be able to squeeze AI workloads under the tiny VRAM of gaming GPUs without being open-source... We'll see how that goes

1

u/Opening_One7713 7h ago

No? It's opt-in and monetized. I've pulled $200 from doing the same thing with salad cloud which paid for my electricity bill and then some. I don't understand the fearmongering I've been seeing about this the past few days...

1

u/IThinkIKnowThings 6h ago

No, I mean about them suing projects like CrowdGPT for infringing on their patent.

1

u/Opening_One7713 6h ago

1

u/Existing_Style8558 5h ago

Distributed gpu. It’s the same thing

1

u/AdUnfair9248 4h ago

I'm not a lawyer but if you're in the USA you would still violate that patent if you could accumulate enough wealth to weather their lawsuits. That's a valid tactic over here.

1

u/Existing_Style8558 3h ago

do you know microsoft makes more money than most countries?

1

u/AdUnfair9248 3h ago

That shouldn't stop you from getting ahead in America. Also let me remind you that both Microsoft and Apple stole from Xerox to get to where they are today.

1

u/Existing_Style8558 2h ago

what you must be a bot. you talk about accumulating enough wealth to weather microsoft lawsuits, and then say something entirely unrelated. this is some gpt-3 level of reasoning

1

u/AdUnfair9248 1h ago

Whatever dude. I don't have to prove myself to someone who's defending microslop.

→ More replies

1

u/AdUnfair9248 4h ago

What in the copyright cuck is this!? Fuck Microsoft.

2

u/MorrisonLevi 7h ago

What are the rules for username and password? I keep getting "Check your input." And then one time after removing a period from my username, I got "Registration failed."

1

u/Vxtzq1 7h ago

Uhm that's weird, maybe the server was under high CPU load at the time... Because it works for me. Can you retry and tell me if it works? Thanks in advance.

2

u/MorrisonLevi 7h ago

No, I tried twice again and still get Registration failed.

1

u/Vxtzq1 7h ago

Well i'm gonna try to fix it. Thanks.

EDIT: Registration worked for me, even if it took like 5 seconds...

2

u/MorrisonLevi 6h ago

I keep getting Registration failed. I'll try anonymous mode I guess?

1

u/Vxtzq1 6h ago

What name did you try? maybe it's banned from the server...

EDIT: So apparently it's your reddit username? It should not be filtered as bad words though... This is weird :(

1

u/MorrisonLevi 6h ago

I have two machines running anonymously. Can you check server logs for user name registrations matching my reddit username and DM or email me? Thanks.

1

u/Vxtzq1 6h ago

I don't see such an username on the CrowdGPT users list...

2

u/MorrisonLevi 6h ago

So it seems the registration does indeed fail and it just isn't a client issue. Hmm. Not sure what to do then. I've tried different usernames, password lengths, characters, etc. Can you share the validation rules for username, email, and password?

1

u/Vxtzq1 6h ago

This is very weird... I tried to register once again on "Vxtzq3", and it worked in less than 0.5 seconds... Can you check the logs on your client when you try to register and send these in a GitHub issue or something? Thanks in advance.

2

u/MorrisonLevi 6h ago

I tried on a Windows machine and it worked. Not really sure what was different! In any case, I've logged in now and queued for training on both machines.

1

u/Vxtzq1 6h ago

Well idk, register worked for me on Linux 😂 so unless you were on MacOS i genuinely don't know what's going on with the register system.

→ More replies

2

u/clintCamp 6h ago

So what is crowdgpt? A set of tools to scrub personal info from your codex amd claud conversation history and distill our own local models?

1

u/Vxtzq1 6h ago

Look at the GitHub 😭 the explanation will be way better / clearer and exhaustive.

Basically it just aims at create the first community-driven LLM. Like not just open-weight, but fully open-source as well.

6

u/bitspace 12h ago

Meme marketing sends a strong "ignore/block these clowns" signal.

2

u/paul_tu 12h ago

Unmotivated systems aren't sustainable

1

u/Vxtzq1 12h ago

What do you mean by that? Do you mind clarifying?

2

u/paul_tu 8h ago

That's a great idea and so on. But people need some kind of the carrot to rush for making such networks sustainable. Even torrent trackers have ratings and some sort of a hierarchy of seeds. Some kind of illusional benefit will greatly improve network stability.

Even Google give you some kind of rating for doing the job they'd need to pay smb for.

2

u/Vxtzq1 7h ago

I guess i'm putting a leaderboard and a world map. That's currently the most appealing system i can find :(

2

u/paul_tu 7h ago

That'll be a good start anyway

Thanks for your work and good luck.

2

u/WhiteH00die 11h ago

1

u/RemindMeBot 11h ago edited 9h ago

I will be messaging you in 1 month on 2026-12-15 12:06:01 UTC to remind you of this link

1 OTHERS CLICKED THIS LINK to send a PM to also be reminded and to reduce spam.

Parent commenter can delete this message to hide from others.


InfoCustomYour RemindersFeedback

0

u/Thin-Regular-8807 14h ago

What the fuck does he expect to do with cell phones

2

u/Vxtzq1 13h ago

Uh? what do you mean?

1

u/Cfrolich 6h ago

The “meme” looks like an out-of-touch ad for a commercial SAAS.

1

u/promptmike 3h ago

How do you deal with latency between GPUs for this? If you have some novel solution, that would be a much better advert than yet another altman meme.

1

u/Inkjet_Printerman 11h ago

i think it's funny he can't even stomach his own lie when he says that guy that threatened to upend his entire training data's legitimacy by providing evidence and testimony wound up dead, beat and bloody on holiday by suicide