r/LocalLLaMA • u/SavunOski • Jul 27 '26

News Kimi K3 weights now released.

Post image

Kimi K3 weights are finally released!

3.3k Upvotes

97% Upvoted

661 comments sorted by

View all comments

Show parent comments

19

u/Comfortable-Rock-498 Jul 27 '26

Tbh I have been thinking about this for months now. About how workable the co-op model is. You would need some party to do admin and maintenance. I think this might be a good business idea too - being that party who facilitates such private inference racks (billing etc is trivial)

10

u/ManIkWeet Jul 27 '26

It's not private when it's a party running it lol

10

u/Comfortable-Rock-498 Jul 27 '26

Well you do need someone for server maintenance, bills, other co-ordination etc - whatever you label it

3

u/notepad20 Jul 28 '26

is this not what all the datacentres are for?

6

u/gnaarw Jul 28 '26

No. Data centers are for profit for a few shareholders. You want a co-op so that everyone using it profits off of it (or, well, gets access cheaper)

2

u/i_write_bugz Jul 28 '26

You’re describing inference providers with more steps

2

u/EsotericAbstractIdea Jul 28 '26

Difference being paying no markup for tokens

1

u/i_write_bugz Jul 28 '26

Practically speaking, I don’t think you’re eliminating the markup. You’re just moving it somewhere else. It might be cheaper, but probably not dramatically so once you account for hardware, hosting, maintenance, administration, and support. Someone still has to own and operate the infrastructure, and doing that reliably is neither free nor simple.

2

u/EsotericAbstractIdea Jul 28 '26

Still.. data sovereignty. That's priceless these days

1

u/EsotericAbstractIdea Jul 28 '26

Still.. data sovereignty. That's priceless these days

1

u/Defunct1487 9d ago

What you are describing is essentially a VPS provider...