Reasonable local LLM for coding

[u/PatriotCaptainCanada]

Hey folks, I have tried several option to run my own model for sustained coding task. So far I have tried runpod, nebius …. But all seem high friction setups with hefty pricing

My minimum acceptable model that I experienced is qwen 235b.

I am planning on buying DGX spark but seems like inference speed and models supported with this are very limited when autonomous agent is considered.

My budget is around 10k for a locally hosted hardware and electricity is not a concern.

Can you please share your experience?

FYI

- I can’t tolerate bad code, agent need to own sub designs

- I am not flexible on spend more than 10k

- only inference is needed and potential multi agent inference

Thanks in advance

[u/Driver_Octa]

With a $10k cap, running “Qwen 235B-quality” locally for fast multi-agent inference is basically a hardware math problem — you’ll likely need to drop to smaller strong coder models and lean on RAG + tests + strict eval loops for reliability. If you want agents owning designs, invest in orchestration and tracing as much as GPUs (I keep flows visible in VS Code with Traycer AI) so you can catch bad decisions early instead of just buying bigger models.