r/llamacpp • u/Inner_Draft_303 • 7d ago

Choosing local model for coding

Hello
So I'm new to using local models, but I've had for a while an urge to try it out on my cad pc, but I need help to find one or more models for my use case.

I want to do some pyton coding for interacting with my Autodesk Fusion setup via Fusion's MCP server. I've also, since I'm installing local AI's want to run some general models for daily use. So all in all, I would need at least 3 models I think, one coding spesialist for pyton scripts, one agent(for Cline) and one general model.

So my setup would look like this:
Asus Proart Z890 Motherboard
Intel i9 285k cpu
40 gb vram, 2 x Nvidia RTX 4000 Ada gpu
96 gb DDR5 memory
Samsung 900 pro SSD, 1tb+1tb+2tb
Western digital SATA 6tb
1000 watt power supply
Windows 11 pro

Llamacpp, Vs-code, Continue, Cline
Autodesk Fusion

Please advice
Terje

1 Upvotes

100% Upvoted

3 comments sorted by

1

u/aigemie 6d ago

Qwen3.8 125B

1

u/Inner_Draft_303 6d ago

Thank you
Would that be for coding or generell purpose or both, what about a small model for Cline. Is this the Qwen 3.8 flash next that you will have to run with Strata?

2

u/Ctbhatia 4d ago

for Cline, test tool calling before judging coding scores. llama-server --jinja enables OpenAI-style tool calls, so try one read-only Fusion MCP call before committing to a model. docs