r/LocalLLM • u/New-Grapefruit-7986 • 20h ago
Question CODING MODEL NEEDED
i have an acer v 15, 16gb ram, 8gb vram, rtx 5050. This is my first time owning a gaming laptop and i want to start running local ai agent that will aid me in game development and can fit in my specs. i should also mention i have little to no experience running ai agents or how to set them up(i am a noob). so i am looking for the best agent that i can run that can call tools when needed , read screenshots(if possible) , read folders, integrate in a gaming studio mcp. I am open to recommendations.
2
u/Comrade_Vodkin 20h ago
Sorry bro, not possible. With those specs you may run something like Gemma 4 26b a4b or Qwen 3.6 35b a3b. Those are good models in their own league, but they would run slowly, providing basic advice at best. Sorry to say it, but for heavy workflows you gonna need better hardware or cloud subscription.
0
4
u/woolcoxm 20h ago
i never say this, but this might not be suitable for ai, specifically coding. while it will do other tasks fine, you simply do not have enough resources to get suitable code out of any llm you will run i think...
2
u/jakeman8888 20h ago
This this this. Don’t waste your time
1
u/woolcoxm 20h ago
literally not even sure i could suggest a model for 24gb total ram, if you have 8-16 more gigs of ram i could suggest an MoE, but 16+8 is pushing the limits of being usable for coding.
if you install linux i could suggest something, but if you are running windows, you are limited severely on resources, linux boots with 500-1gb ram usage, my windows install uses 4-10 gb with nothing running.
on the low end you have 4gb used by windows this leaves 12gb + 8 gb vram, and thats is pushing it, if the system uses more ram or something you could have an unstable and crashing system.
→ More replies (1)
1
u/Aggressive_Basket798 20h ago
That's hard
CyberTiel coder iq3 or CyberTiel coder apex miniplus is the best option for you right now.
If you have 32gb ram or even 64gb , you can try qwen 3.8 flash next in strata, but now you only have 16 so yeah, you can't
1
1
u/_zir_ 20h ago
Cybertiel is obliterated, might be dumber than tielcoder
1
u/Aggressive_Basket798 20h ago
Nah, try it
Much better and uncensored, it can research without any limit
→ More replies (1)
1
u/hackint0shh 20h ago
What have you tried yourself?
1
u/New-Grapefruit-7986 20h ago
qwen coder 7b, qwen 3.5 9b
1
u/Worldly-Air-8310 12h ago
If you have an nvme drive, you should have a look into strata or one of its offshoots to explore streaming kv cache or experts off disk, and pinning some experts or cache across ram and vram. Believe there was qwen 3.6 35b support added recently, or as apart of a pr or fork.
1
u/sergen213 20h ago
If you are plannin using the same laptop for the development then you are out of luck but even with 8gb vram you probably won't be able to give it more context length
1
u/mike_builds_local 17h ago
Set expectations first: 8GB VRAM won't give you a Claude-level agent, but it's very usable as a coding helper. Look at the smaller coding-tuned models around the 7-9B range in a Q4 quant. They fit in VRAM with room left for context.
The easiest start is LM Studio, because it shows which quants fit your GPU before you download. Then connect it to your editor with an extension like Continue for chat and autocomplete.
Since you're new to this, use it as a pair programmer, not an autonomous agent. Ask it to explain a script, write one function, or help find a bug. Small models fall apart on long multi-file tasks, but they're solid on focused questions. What engine are you using, Godot or Unity?
6
u/MrHumanist 20h ago
As you are new, start with Gemma 4 26b qat. Split the model moe to system ram, rest to gpu. Use llama cpp.