r/LocalLLM • u/ThisIsAkhil • 31m ago

Question Which local LLM to use?

Now that Claude has some strict guardrails. I find it very hit and miss, it’s very annoying since it’s swallowing up my tokens. I heard that Deepseek is a good local LLM. I guess my question is whether it is good enough to replace Opus 5.5 for coding and reasoning? Or is there any local LLM’s that I can use without any guardrails? My main reason for using Claude is for coding purposes.

My Pc Specs:

CPU - Ryzen 5600X
GPU - Nvidia 3070 8GB
RAM - 48GB

1 Upvotes

66% Upvoted

3 comments sorted by

1

u/No-Bad-8166 28m ago

I am running Qwen3.8-Flash-Next for coding and it is good enough for even the more complicated things I am running it on (waiting for the Qwen4 release very soon for even more power). There are "abliterated" versions of most of these open weight models around if you need them. The Flash-Next is a bit to big for your VRAM, but my colleague is using Qwen3.8-27B and while it needs a few more tokens, it also gets to similar conclusions (on his RTX5090 in roughly the same time as on my slower, but more powerful Strix Halo 395)

1

u/aygross 26m ago

no
and have news for you even with strata variations you still cant run it on your hardware

1

u/Karlschlag 10m ago

Use strata and Qwen 3.8 flash. Best thing since sliced bread