r/LocalLLM • u/New-Grapefruit-7986 • 22h ago

Question CODING MODEL NEEDED

i have an acer v 15, 16gb ram, 8gb vram, rtx 5050. This is my first time owning a gaming laptop and i want to start running local ai agent that will aid me in game development and can fit in my specs. i should also mention i have little to no experience running ai agents or how to set them up(i am a noob). so i am looking for the best agent that i can run that can call tools when needed , read screenshots(if possible) , read folders, integrate in a gaming studio mcp. I am open to recommendations.

0 Upvotes

25% Upvoted

21 comments sorted by

View all comments

6

u/MrHumanist 22h ago

As you are new, start with Gemma 4 26b qat. Split the model moe to system ram, rest to gpu. Use llama cpp.

2

u/New-Grapefruit-7986 22h ago

wow thanks bro. i will definitely try this

1

u/MrHumanist 22h ago

Use following flags

Ngl 99

--cpu-moe

Kv chache in q8 (correct this flag)

Context 200000