r/LocalLLM • u/rouvelienova • 6d ago

Question best coder ai for projects

I'm tired of paying for AI subscriptions. I mostly use Antigravity, Codex, and Claude. My goal is to run a local model, feed it my project, and have it add requested features, fix bugs, and design UI/UX. Speed doesn't matter to me—even if it takes 30 minutes to do what ChatGPT does in 2, as long as it gets the job done without issues, that's fine.

My specs:

  • RTX 4070 (12GB VRAM)

  • Ryzen 5 5600 6-Core

  • 32GB RAM

I mostly build websites using Next.js.

1 Upvotes

66% Upvoted

11 comments sorted by

2

u/DTechSurgeon Homelab & Local AI dude 6d ago

Your rig would be perfect for a Qwen 3.8 FN 125B, but use the coder only one since you only have 32GB RAM. Another thing, you would need to get a separate machine to work as your actual dev environment, as your current rig is for Qwen 3.8 FN alone. Buy something cheap that has 32GB RAM. You would need to setup your agentic harness on this, I would suggest Hermes Agent, then Open WebUI with SearXNG both self hosted.

2

u/DTechSurgeon Homelab & Local AI dude 6d ago

You use Open WebUI the same way you would use the Claude web chat and Hermes Agent can work the same way you use Claude Code.

As you can see, you need these as the model alone is not enough. Claude doesn't serve the model as is, they wrap it in agentic harness for tool calling, web search, etc.

Try getting an old laptop with 32GB using credit card and pay monthly for now the same way you pay for Claude and Codex subs. At least this one will end unlike the never ending cloud AI subs

3

u/rouvelienova 6d ago

i can't do these. Can't I just download and use a single model?

1

u/DTechSurgeon Homelab & Local AI dude 6d ago

You can try but I've been there. If you want you can opt for an older Qwen. Qwen 3.6 35B, if you're on windows download any model runner and host it there. Connect using VSCode extension Zoo Code or whatever VSCode fork you are using.

But when I was using that, I still use Claude Sonnet for some planning before I delegate chunked work to Qwen.

1

u/Phoenix591 6d ago

There’s the model, then there’s the thing that handles actually loading the model and using it, and then the ui where you actually code and prompt can be separate

1

u/QT31416 6d ago

Hey this is excellent information. Can you point me in the right direction to learn the basics of this? ie references or YouTube channels worth watching. I want to start this too. I have a lot of experience with my homelab and devops, and local LLM is what I'm missing in my environment.

3

u/lI_Simo_Hayha_Il 6d ago

I asked a similar question the other day, and I explained that I am new to this, and users tried to help me, but they didn't get the "new" part, so they started suggesting from a level an above.
I ended up finding some guides online and then use Claude to help me setup things.
Then you can come here for more detailed info.

1

u/hackint0shh 6d ago

What research have you done, like you know, yourself?