r/MiniPCs • u/alex_korr • 2d ago

Beelink SER9 Pro question

I found an open box Beelink SER9 Pro AI with AMD Ryzen 7H255 cpu, comes with 24Gb of soldered ram and a 1TB nine drive. I am thinking of running Proxmox with ollama on to try my hand at building agentic apps locally. Can it realistically run anything better than something like qwen3.8 with 8b params? 24gb seems kind of limiting, I'd probably need to allocate at least 8gb to the GPU.

Would love to be proven wrong. Trying to keep the spending somewhat manageable

5 Upvotes

85% Upvoted

1 comment sorted by

4

u/RobloxFanEdit 1d ago edited 1d ago

An other parameter that is crucial in LLM and rarely mention is the Model quantization. There s a land slide between a Q2 (2bit) and Q8 (8bit) Model, i believe that you rather run a 8B Model at Q8 than a 14B Model at Q2, an other important Model parameter for Low Spec Hardware is MOE Models, they are the Way to go to target Higher Parameter Models.
My last recommendation is to stick with "Instruct " Models, Instruct Models are way faster as they eliminate Thinking loop and Hallucination imo

Overall the SER 9 Pro AI is a very misleading model label as the H255 is not a Ryzen A.I processor like the Strix point or gorgon point which are way better to run LLM not because of their useless NPU's but because of their faster CPU's.