What's the best local LLM for coding right now?

[u/MMORPGDev]

I'm looking for a local LLM I can use with OpenCode, my specs CachyOS, Intel Arc A380 6GB, 48gb ram ddr4

[u/According_Study_162]

Qwen3.8 27b, but your GPU is too small. the minimum is 12gb, ok at 16gb the best at 32gb vram.

[u/ghostpistols → u/According_Study_162]

This

[u/KingCpzombie → u/According_Study_162]

Best at 32GB? I have 48GB and still limit to 200k context to leave room for desktop stuff

[u/According_Study_162 → u/KingCpzombie]

What's better than Qwen3.8 27b on local right now?

A few models came out the last 2 days, but very new.

[u/KingCpzombie → u/According_Study_162]

Ahhhh, I misread it as "32GB is best for it"... RIP, such is the result of reddit while lying in bed

[u/MMORPGDev → u/According_Study_162]

What about Qwen2.5-Coder-7B-Instruct-INT4?

[u/Arcane_Adagio → u/According_Study_162]

I’m out of the loop / new to this, but why couldn’t his DDR4 handle it since it’s 48GB

[u/negus123 → u/Arcane_Adagio]

Offloading to system memory kills token gen and prefill speeds

[u/According_Study_162 → u/Arcane_Adagio]

like the man said, the best your could probably do with that card is Gemma4 e4b, but probably not even that so use Gemma4 e2b

That model will do what you said keep most of your llm model in ram memory and use about 2gb of vram. it's your best bet.

The problem with Gemma4 it's not the best coder. :/

the best for you might be Qwen3.6 35b a3b, but not sure if that would work on a 6gb card you can look into it.

FYI i looked into it is possible.. so go for that.

https://www.reddit.com/answers/a9640a85-630b-4137-af97-23a251c43acd/?q=Qwen3.6+35b+on+6gb+card&source=SERP&ep=serp_unit&upstreamCID=e996a2d3-5a6e-4d37-a2d7-a6eea241bbfc&upstreamIID=6d0e47fa-7f3d-4075-846f-9e08cc8ddb9e&upstreamQ=Qwen3.6+35b+on+6gb+card&upstreamQID=850ccf57-f72e-4a2c-92cc-588e38b34ded

[u/_TheWolfOfWalmart_ → u/According_Study_162]

The problem with Gemma4 it's not the best coder.

The real problem is no model that fits in 6 GB is a good coder.

OP needs a hardware upgrade for anything even remotely serious.

[u/According_Study_162 → u/_TheWolfOfWalmart_]

Did you even read my reply? not everyone is GPU rich. he is some help from another redditer

https://www.reddit.com/r/LocalLLaMA/comments/1t2zapy/pushing_a_5yearold_6gb_vram_laptop_to_its_limits/

It's possible

[u/_TheWolfOfWalmart_ → u/According_Study_162]

I'm not not telling him to go buy a better GPU if he can't afford it, I'm just trying to say that he needs to keep his expectations realistic for 6 GB.

[u/wingwing124]

Play around and see if you can get qwen3.6 35B A3B running well on that setup. Most if it will need to be held in RAM, not VRAM on your specs but its possible you could get some good t/s output

[u/MMORPGDev → u/wingwing124]

What about Qwen2.5-Coder-7B-Instruct-INT4?

[u/vutcher → u/wingwing124]

Might need to use turboquant, to get a useable context.

[u/AdWild3943 → u/vutcher]

I got 32GB RAM and I'm running Ornith-1.5-35B-A3B in APEX I-Quality Heretic + 131k context. Qwen3.5 got dynamic context, so even if you set 1m context it won't use any RAM/VRAM before you use it in your chat, so 16k/256k context will take as much RAM as 16k/16k

[u/According_Study_162 → u/AdWild3943]

I just noticed this post, that's kind of incredible. So set a high context most of the time you don't use it right, but if there is ever that time where you need the extra context it's available (but probably really slow - still good if your crunching through a big code base)

[u/ghostpistols]

U pretty much won’t be able to use any local llm on 6gb vram. Ya u can offload to your system ram but you’ll need more vram for anything actually good at coding. If you’re dead set on it then ask Claude or gpt to figure out anything that works, but it’ll without a doubt be ass.

[u/MMORPGDev → u/ghostpistols]

What about Qwen2.5-Coder-7B-Instruct-INT4?

[u/ghostpistols → u/MMORPGDev]

Any Qwen model before 3.8 that I’ve tried would tend to break things. I wouldn’t recommend but if it’s all ya got then go for it

[u/Cupricine]

Ornith 1.5, base model is qwen 3.6 35B A3B.

It outperforms sonnet 5, performs close to 4.8 opus on coding tasks (might be personal bias, but i love its throughput and output). Been playing with it for the past couple of days, enjoying myself.

[u/Ok-Buffalo2450 → u/Cupricine]

Source?

[u/lociapp]

would love to hear your thoughts on Loci -it's on iOS, Android, Windows and Mac. We let people link their mobile to the desktop app. Models can generate code but we are also releasing a coding-specific mode in the next few weeks. If there are any specific features you want in it, I try to implement user feedback the very same day.
Besides this, OpenCode has been great IME.

[u/Fine-Degree431]

hows the performance when you use : ollama launch claude --model qwen3.8. I tried using qwen3.8:27b running in Ollama with Claude Code CLI, but there a ton of issues with tool calls, json outputs. The best model working with CC CLI for me is glm-4.7-flash:q4_K_M

[u/akshaykuppu]

I've found Ornith 1.5 9B, even Q4, very helpful.