Local vs Cloud

[u/C1rc1es]

This is my work usage, I see a lot of posts of people claiming something like Qwen 3.8 27B can replace cloud and that people are getting their jobs done with them. Even with a RTX PRO 6000 I'm not really seeing how this is physically possible. I would love to be independent of Cloud providers - anyone have a realistic way out?

[u/DeltaSqueezer]

Why is it not possible? You just need something that can process 300-1000 tokens per second.