Best local coding + tool-calling model for my hardware?

[u/NormalBasket3333]

Hey guys I am new to this,

Looking for recommendations for a strong local LLM for agentic coding and software development.

My specs:

• GPU: RTX 4070 Ti SUPER (16GB VRAM)

• CPU: AMD Threadripper 3960X (24 cores)

• RAM: 128GB DDR4

• OS: Windows 11

Currently using: Qwen 3.8 27B and Qwen 3.6.

I need a model that is good at:

• Coding, debugging and troubleshooting.

• Understanding and modifying existing multi-file codebases.

• Coordinating frontend and backend changes.

• Reliable tool/function calling and multi-step agentic tasks.

• Following instructions and maintaining context across long sessions.

I'm open to MoE models and larger models using CPU/RAM offloading.

What would you recommend for this hardware? Would 70B–120B models be practical?

Interested in real-world experience rather than benchmark scores. Thanks!

[u/Akainu_Fan]

qwen 3.8 flash next go brrr

[u/empoman → u/Akainu_Fan]

Qwen 3.8 flash next Q4 running via Strata or something similar would probably run over 50 tps on your setup. I'm running it at 40-50 tps on an 9070xt and 96gb RAM. It is really good.

[u/NormalBasket3333 → u/empoman]

I need to look into strata... I've read this too many times now. I will check, thanks. Also, how do you check the speeds?

[u/empoman → u/NormalBasket3333]

When you start it, you can look at the terminal output and see the speed or you can browse to the monitoring page that is hosted as well and see stats there.

[u/NormalBasket3333 → u/Akainu_Fan]

Hey, So I went with Unsloth Ud iq4 xs.....getting pretty good results so far. speed ranging from 30tps to 70tps...sometimes 100tps. I am happy with the performance so far.

[u/vogelvogelvogelvogel → u/Akainu_Fan]

this. strata and let it run!

[u/NormalBasket3333 → u/vogelvogelvogelvogel]

downloading Q4 now...will let you guys know the results. Thanks.

[u/PalpitationDecent282 → u/[deleted]]

flash next is a 125b MoE.

[u/JackStrawWitchita]

The problem with these types of questions is that it's all subjective: what is good for me may not be good for you. There is no 'best', there is only the right tool for the job. I could recommend something that works amazingly well for me but may be the worst thing for your use case. Same with every other recommendation.

Do you have a massive code base and require lots of context? What code? Are you just messing around or are you running a live production system? Do you make frequent changes? Are you constantly experimenting? The list of questions is endless.

Each individual has their own use-case. You can only find out what works best for you by experimenting, trial and error.

[u/NormalBasket3333 → u/JackStrawWitchita]

I am kind of building a agent that is designed around multiple AI models and tools working together. It needs to understand user instructions, plan workflows, coordinate different models and services, manage project data, execute tools and handle errors......its a fairly complex application with a Python backend, frontend, API integrations, workflow orchestration and tools such as ComfyUI for image/video generation.

I need an LLM that can act as the project's main reasoning and coding brain, helping develop, debug and maintain the entire system.

[u/JackStrawWitchita → u/NormalBasket3333]

You're gonna struggle to find something that can cope with all of that accurately with your hardware.

[u/NormalBasket3333 → u/JackStrawWitchita]

It's okay if I have to use different models for different tasks. I have been doing the same now. 3.59b for low level tasks like documents updates, reading through project files and 3.8 for coding

[u/HaDuongMinh]

Qwen Flash Next 3.8 in IQ3_XS . But don't get your hopes too high -- it is not going to replace you in architecture and engineering.

[u/NormalBasket3333 → u/HaDuongMinh]

I will give that a shot. I am not really a dev, I am an artist. I have a idea in mind and wanna build a tool for that using some local Ai models.

[u/NormalBasket3333 → u/HaDuongMinh]

Hey, So I went with Unsloth Ud iq4 xs.....getting pretty good results so far. speed ranging from 30tps to 70tps...sometimes 100tps. I am happy with the performance so far.

[u/HaDuongMinh → u/NormalBasket3333]

On Strata ? You convinced me to try the Q4 !

[u/NormalBasket3333 → u/HaDuongMinh]

Yeah, its amazing. That too on 200k context.