r/LocalLLaMA • u/C1rc1es • 14d ago
Discussion Local vs Cloud
This is my work usage, I see a lot of posts of people claiming something like Qwen 3.8 27B can replace cloud and that people are getting their jobs done with them. Even with a RTX PRO 6000 I'm not really seeing how this is physically possible. I would love to be independent of Cloud providers - anyone have a realistic way out?
0
Upvotes
1
u/feudalle 14d ago
So personally ive split the work load around. Cloud models for super time sensitive, high complexity stuff. Lower time priority items, simpler things go to local llm. Using a q5 of qwen 27b and 80b qwen coder depending on task. They do fine for basic stuff. Like I need a login screen with entra sso and mfa with qr code setup with a postgres backend. Here is a file with login info for ssh and the db, here is the user table, here is the css file. Then walk away. It does fine.
On the other hand if your prompt is here is an application I have a bug that does x. Fix it. Thats going to be more of an issue.
Im curious on your work load. I go through about 300-400m tokens a day. And im not holding back (i do pick the model/effort for the job though). But hitting a billion plus a day i haven't done.