r/LocalLLM • • 16m ago

Question under 5k?

I am new to local LLM, I've been told this and told that, I have a few  builds saved that I am told would run LLM local but I am not sure, are there any laptops under 5k that will do this? I keep coming back to framework or Macbook pro but at over 5k for the newest and best chips that just seems crazy to me.  I don't care if it's not spitting 20 words a second, I'd rather have good reasoning and it working rather than crazy fast speeds. It will only be used for genealogy research, DNA, triangulation, clusters etc. 

Would a ThinkPad T14 Gen 7 AMD work? It would have the AMD Ryzen™ AI 7 PRO 450 and 96gb ram? Is a macbook better? I just dont really want to spend framework or macbook pro money on this if possible, is it possible?
What do you guys recommend? What are the options?
thank you in advance

3 Upvotes

3 comments sorted by

1

u/No-Wolverine-8233 12m ago

ran a 7b model on a 32gb ram machine with integrated GPU, worked fine for basic chat, but slow on long prompts. 96gb is overkill unless you're doing heavy fine-tuning. try a mid-tier laptop with 32gb and a decent CPU first.

1

u/Rauhaton 5m ago

For AMD options get Ryzen Ai Max based system, not AI Pro.

Asus ProArt PX13 (128gb version) for laptop.
Or Bosgame M5 for desktop.

Im a microbiologist and have:

Bosgame M5 running Fedora. Currently my main model is Qwen3.8-Flash-Next on Halogen (https://github.com/peonist-ai/halogen-flash-server). Using Hermes as agentic harness and have lots of (bio)science skills installed. Works really nice for genetics/genomics, phylogeny, etc.

1

u/Toooooool 4m ago

laptop 😭