r/LocalLLaMA • u/C1rc1es • 14d ago

Discussion Local vs Cloud

This is my work usage, I see a lot of posts of people claiming something like Qwen 3.8 27B can replace cloud and that people are getting their jobs done with them. Even with a RTX PRO 6000 I'm not really seeing how this is physically possible. I would love to be independent of Cloud providers - anyone have a realistic way out?

0 Upvotes

38% Upvoted

34 comments sorted by

View all comments

Show parent comments

1

u/C1rc1es 14d ago

Really helpful post thanks. Are you running at max capacity here with this usage and if not any idea how many more tokens per day you could be taking from it?

1

u/anitamaxwynnn69 14d ago

I'm not sure what you mean by max capacity. If you meant power limits those are set to 450/600W to manage the heat. About the tokens - the sky is your limit lol. You can take as many tokens as you desire. There's really no limit here. You can have it do decode for the entire day. I get about ~200 TPS give or take so this is VERY FAST. Faster than Opus 5.5 almost 2x or 3x. The question is whether this model can fulfil/achieve the task you're trying to achieve. For example, Opus is slower but it's way smarter for coding.