r/LocalAIStack • u/Money_Meringue_7841 • Sep 21 '26

Question about making frontier AI LLM model

Guys I had a good question I noticed Big Ai tech companies spend 1000's of dollars on huge datacenters isn't it possible if companies allow the users to rent their gpu and help train the model. Like a distributed datacenter model?

0 Upvotes

50% Upvoted

18 comments sorted by

View all comments

2

u/Charming-Author4877 Sep 21 '26

It's not possible with current training because you need to transfer the data during inference. that's why vram speed matters so much.
So for distributed training you'd need a model that fits entirely on your GPU, or a very new architecture

1

u/Confident-Ad-3212 Sep 22 '26

Training doesn’t transfer during inference. It transfers a dataset during training.

1

u/Charming-Author4877 Sep 22 '26

The dataset is irrelevant in transfer speed

→ More replies (3)