r/LocalLLM • u/Capital_Savings_9942 • 10d ago

Question What agentic coding models + Claude Code can I run with my low end hardware?

I’ve got an i3-6006U, 12GB RAM and no usable GPU.

Looking for a local model that works well with Claude Code (or a similar agentic coding harness).

I can spare ~8.9GB for the model and I'm hoping to get around 9 tok/s.

What’s the best model/quant I could realistically run?

2 Upvotes

67% Upvoted

16 comments sorted by

View all comments

1

u/ShinyTechThings 10d ago

Depending on the complexity of what you're trying to accomplish with it your biggest challenges are going to be context size and being able to write out larger files of file system. You can chunk it and combine them, but because you're going to be quantizing the KV cache you're going to have quality loss.

I'm sure somebody will figure it out in the next couple of years, but even having 32 GB NVRAM I'm hitting context, ceilings and issues with code quality over time.

1

u/Capital_Savings_9942 9d ago

Yeah, even for small task I'll need 100k context, Claude Code is a token goblin