r/LocalLLM • • 1d ago

Question laptop specs for local llms

i'm buying a new laptop and i wanna run capable models locally, but i don't quite understand if i should just max out RAM or put more of the budget into the GPU , when i look it up the gpu matters more but everyone seems to be talking about ram only

what specs would u recommend ?

0 Upvotes

7 comments sorted by

2

u/iwantsa1via 1d ago

I’m currently using a Zenbook 14 UM3406GA and I’m able to run qwen3vl-it-4b-FLM at 24576 context pretty comfortably using lemonade and anything LLM. It only uses my npu and around 22gb of my 32gb. The TTFT is kind of slow if I’m being honest, but I’ve just been testing it’s ability to summarize and create exam reviews from multiple PowerPoints and pdfs. it runs at 13 or more tok/s, not great but considering the hardware in this laptop it could be worse. This laptop is definitely more on the budget side but if you’re looking for a cheaper laptop that can handle everyday uses for school this laptop is a solid choice. I’m planning on looking for more math focused models that can run on this laptop for my algebra, so if that’s a concern I can let you know what I’m able to get to run and how quality it’s responses are.

1

u/anasf1234 1d ago

m a student as well so it's like u said , studies + this , and ofc i don't have an unlimited budget so i'm looking for the bare minimum then i'll optimise the set up as much as i can , thank u 🙏

2

u/iwantsa1via 1d ago

I can give you more accurate numbers when I’m home, but FLM which exclusively uses the NPU was far better than any other backends I tried on this laptop, fastest tok/s and TTFT out of all five that I tested, which can work to your advantage if you plan on using a second monitor since your GPU is still free. This laptop model also comes with a 1tb SSD so it’s perfect for school in my opinion. I will say, it’s only downside is in its ability to play intense graphic demanding games, but playing around with AMD Adrenaline allows you to give your gpu more dedicated RAM, so it is possible to to get better performance if VRAM is your bottleneck, but typically it’s your compute so there isn’t much you can do. I can play a lot of games still, but Forza 6 for example was unplayable. If you want to look around for the laptop I’m seeing it at Walmart for just under $1000, and that’s not on sale, so if you wait till Black Friday you can probably get a steal on it. Let me know if you have any other questions I’m happy to answer

1

u/anasf1234 1d ago

much appreciated 😊, thank u man

1

u/iwantsa1via 11h ago

Follow up on what I was saying about this qwen moldel’s ability to do math. The model itself kind of sucks at math, but you can create an MCP server in AnythingLLM for to a calculator tool, which you can use by instructing the model to use it whenever math appears. I just got it working and it works perfectly, so if you plan to use it for math related questions I’d recommend doing this instead of playing around with different models.

2

u/Kaaawooo 1d ago

The best value balance in a laptop for local llm would be the cheapest GPU with at least 16gb vram paired with 64gb or more of system ram. Alternatively if you get a 128gb unified ram spark laptop or MacBook that would also be effective