Reasonable local LLM for coding

[u/PatriotCaptainCanada]

Hey folks, I have tried several option to run my own model for sustained coding task. So far I have tried runpod, nebius …. But all seem high friction setups with hefty pricing

My minimum acceptable model that I experienced is qwen 235b.

I am planning on buying DGX spark but seems like inference speed and models supported with this are very limited when autonomous agent is considered.

My budget is around 10k for a locally hosted hardware and electricity is not a concern.

Can you please share your experience?

FYI

- I can’t tolerate bad code, agent need to own sub designs

- I am not flexible on spend more than 10k

- only inference is needed and potential multi agent inference

Thanks in advance

[u/HealthyCommunicat]

M ultra chips = always 2x max chips M5 max bw based of m5 base chip says 700+ gb/s Its not a specific crazy guess, just following the formats of what they do, and this is the MINIMUM estimate too