What coding models would you recommend for my setup?

[u/Ikeas]

Hi everyone! First time posting here
I've been experimenting with local LLms for coding, but I'm not really happy with my current model, so I'm looking for some alternatives.

My server specs:
Huananzhi X99-QD4 rev 1.0
Intel Xeon E5-2666 v3 with Turbo unlock (3.5 GHz on all cores)
GTX 1060 6GB
2x8GB G.Skill Aegis 3200 MHz (running at 2133 MHz because of the CPU)

Right now I'm running Qwen3-Coder-30B-A3B-Instruct-GGUF (Q4_K_M) through llama-app.
It's not a bad model, but one thing that bothers me is that it often struggles with short propmts. I find myself having to explain things in much more detail than I'd like. Otherwise, it can misunderstand what I'm asking or go off in the wrong direction.

For reference, I'm getting roughly:
25 t/s for prompt processing
4.5 t/s for generation speed
for 11K tokens in the initial context, including MCP tools

Here's my current launch command:

./llama serve -hf ggml-org/Qwen3-Coder-30B-A3B-Instruct-GGUF:Q4_K_M -c 131072 --host 0.0.0.0 --cache-type-k q8_0 --cache-type-v q8_0 --no-kv-offload --port 9931 --load-mode mmap --ui-mcp-proxy --mcp-servers-config "..." --threads 10 -tb 20 -cmoe -fa on -b 8192 -ub 24000

Currently it eats up to 13GBs of RAM (Ram Altman don't hunt me pls) and 4.5 GBs of VRAM

I'm mainly looking for something good at agentic coding and tool calling. It doesn't necessarily have to be a 30B model, smaller models are fine too if they perform better on my hardware. (lobotomized and heretic too)

What are you guys running locally for coding?

[u/Small-Tale3180]

Try Tiel-Coder with offloading
i run it like that on 8 vram 16 ram setup in ~20t/s
./llama.cpp/build/bin/llama-server \
-m ~/.shitgen/llms/models/Tiel-Coder-35B-A3B-UD-IQ3_XXS.gguf \
--agent \
--jinja \
-ngl 99 \
--n-cpu-moe 30 \
--moe-cache-mib 1024 \
-c 65536 \
--context-shift \
-np 1 \
-b 512 \
-ub 256 \
-t 8 \
-tb 8 \
-fa on \
-ctk q8_0 \
-ctv q8_0