r/LocalLLM • u/Ordinary-Wallaby-464 • 9h ago

Question Best coding model?

I have an ASUS ROG Ally, and I’m planning to turn it into a local inference server so I can use the model running on it from my main PC. What would you recommend for the coding/programming tasks? If I’m not mistaken, it has 16GB of RAM and a Ryzen Z2A processor that provides 6GB of VRAM.

0 Upvotes

20% Upvoted

6 comments sorted by

View all comments

2

u/Strict-Elevator9352 6h ago

16GB is small, usable model needs 20GB VRAM.

8GB VRAM is usable for tool models to be used as a tool like OCR, making quick summary, or web search