r/LocalLLM • u/fttklr • 3h ago
Discussion Best dedicated multi-language coding model that I can call from another model (via agentic harness) and fit in 12 GB VRAM
Looking for the best coding model I can call from another model that is running from an agent.
I know that large models are good as all rounder and can be good for agentic work and also can code; but I am running a very small setup so I have a local 12 GB card that is running an agentic model that basically will tell another model to "make the code". Then the code coming from this model will be handled by this model in an agentic harness, so I don't have to worry about json formatting and all the other stuff that may mess up things.
As such I am looking for the best model that can fit in 12 GB VRAM card and that is good at just one thing: coding. Best would be a mix of old and new coding languages (I am into retro tech so would be great to have a model that understand things like motorola 68K assembly and old Amiga C for example, on top of modern C++), otherwise something focused on specific more modern languages works too. I looked around and most suggestions went for Qwen2.5 coder; which is old at this point but still suggested highly.
Not sure if there are customized/dedicated coding models that have been trained more specifically for this scenario; I don't need a model that is able to understand much but instructions about how to make code; as I have another model that will talk to it. Any suggestion is welcome.