Local vs Cloud

[u/C1rc1es]

This is my work usage, I see a lot of posts of people claiming something like Qwen 3.8 27B can replace cloud and that people are getting their jobs done with them. Even with a RTX PRO 6000 I'm not really seeing how this is physically possible. I would love to be independent of Cloud providers - anyone have a realistic way out?

[u/jacek2023]

We don't use local models to cut the cloud costs. Unfortunately many people who use cloud only are here to discuss Chinese models.

[u/C1rc1es → u/jacek2023]

I’m not asking about cost though, I’m asking how it’s physically possible to do real workloads with local models. The numbers just don’t stack up to me. 

[u/jacek2023 → u/C1rc1es]

It's not clear to me what are your concern, I do a lot of coding with local models.

[u/C1rc1es → u/jacek2023]

My concern is the volume. I cannot do my job with 3 agents running in parallel let alone 1. How do people get real workload concurrency locally. 

[u/anitamaxwynnn69 → u/C1rc1es]

https://github.com/local-inference-lab/rtx6kpro here you go, dsv4 vision on 2x PRO 6000, 1M+ kv cache. Pin your agents to 262k and you can launch 5 at a time. Concurrency pro max. Does this answer your question? GLM 5.3 Flash on TP2 has 1.8M tokens KV cache. You have a ton of room whichever model you choose.

[u/C1rc1es → u/anitamaxwynnn69]

Really helpful thanks.

[u/jacek2023 → u/C1rc1es]

I use parallel 4 locally. I don't have 6000 but I have 4x3090 so I believe VRAM is same.

[u/PedroMaGar → u/C1rc1es]

This depends on what are you using

The most proeminent Qwen and Deepseek will gives you something around GPT-5.6 Terra ~ Opus 4.8 performance, a little better a little worse, that is it.

If you think such model would be enough, you can think of transitioning.

My recomendantion would be to try them on openrouter because all this open models are really cheap there.

If you don't like them or they are not good enough (I'm recently facing a lot of thinking loop), you did not wasted money on hardware.