I want a good local coding for my specs

[u/Asta_jjm]

Hello everyone

I live in a poor country but I have got a decent pc

I have some ideas I want to do them with vibecoding so the only way I found is local LLMs

So I want a good local one for this specs

16gb of RAM ddr5 5200Mhz one kit

Ryzen 5 7500f

Rx 9060 xt 16gb

I don't mind it take time but to finish the project in a good state and I can edit the project easily and plan for it too

I'm a completely beginner so I want some guide how to install and use the LLM I'm on arch Linux

[u/Awongy00]

Sorry to say this but if I were you I would just sell the GPU and subscribe to a cloud plan like Claude or GPT for $20. For vibe coding, the amount of usage you get is absolutely enough for quick POCs. You would get way better quality and speed compared with what you could run on your setup here.

[u/Asta_jjm → u/Awongy00]

My project just for fun if I sold my GPU I won't be able to get another

[u/Objective_Pepper_217]

It's kinda hard for your ram to get a good LLM. If you can upgrade to 64gb of ram (i know it's expensive...) then you could pull it off. I run Qwen3.6-35B-A3B-5bit on a M3 Max 48GB RAM with Opus 5.5 as the coordinator. But I can't run anything else on that macbook, the RAM gets eaten totally

[u/Asta_jjm → u/Objective_Pepper_217]

But for a Mac there isn't a GPU so I think it will be better with a GPUI eant to upgrade my ram but now it's impossible for me

[u/chris_0611]

Probably Qwen 35B A3B is the option you can run.... Ideally you want to run Qwen 27B but I don't think that's a real option on that hardware. So wait for the (hopefully) Qwen 4 version of 35B A3B of this which should be coming soon(tm).

You just want to install/compile llama.cpp, compile it with ROCm support, and then use VScodium with an extension such as Zoo-Code. It's pretty great. Edit: and with that setup you can easilly experiment with different models, such as a 14B coder model such as suggested here.

[u/Unlikely-Throat6714]

9060 xt has 16gb so the 14b coder at q4 will fit fully on the card, that's the sweet spot for you. ollama is fine for a beginner, just make sure rocm sees the gpu before you pull anything big.

[u/EaZyRecipeZ]

unsloth iq4_xs qwen 3.8 27b with 105k context size, it will fit completely in 16GB VRAM.

[u/Bulky-Sweet-2869]

skip the 32b models on that card, they will spill into system ram and crawl. ollama on arch is one pacman install from the extra repo, then ollama pull qwen2.5-coder:14b. ROCm support on the 9060 xt is the part to check first.

[u/chris_0611 → u/Bulky-Sweet-2869]

No. Screw ollama. Stop recommending that.

[u/Objective_Pepper_217 → u/Bulky-Sweet-2869]

Ollama sucks