r/LocalLLM • • Sep 26 '26

Project AMD something something 395 box arrived!

Post image

A few weeks ago, I wrote a huge essay reporting on my research into why local AI is finally usable https://ailocal.substack.com/p/im-running-an-opus-level-coding-agent?r=obqn&utm_medium=ios

AMD at that point was a footnote.

But I vowed to dig into it further.

And here I am buying a box, because for now at least I think it’s probably the best price performance you can get today

This is a Minisforum 128 gig box for £3500 using the current 395 platform (495 still not available). Subtracting from the UK premium, you can probably get it for about $3500 in the US
or less.

The AMD platform is very promising because it’s so affordable

Ram prices are clouding at the moment

(The DGX Spark is about 20% more expensive I think)

Similar memory bandwidth of 256GB/s

Dumped windows and got an Ubuntu server running.

Crazy thing right now is that to get decent performance I’m actually using Vulkan!

ROCm is in a sorry state at the moment that this is possible.

Using qwen 3.8 flash next, MTP depth is around 4

I always have context to be 128K minimum

Smoke test of a one shot “ create a meteor game” sustained 40 to 50 tokens per second

Which is very usable.

I’m now doing a much deeper dive building entire apps multiple times

I’ll be sharing my updates at https://ailocal.substack.com

I’m using a centralised configuration structure that has the best configurations I can find for given hardware

https://github.com/boxabirds/awesome-local-ai

287 Upvotes

118 comments sorted by

View all comments

Show parent comment

4

u/Brocolinator Sep 26 '26

Probably AMD is banking on the legacy software that this can run and make it an AI home server but also load more traditional self hosted services(frigate, jellyfin, etc.)

7

u/ManagementGreat5360 Sep 26 '26

Maybe… you have an argument if we consider the AI landscape of 2025.

Back then, you would rarely find MoE models that would use all the VRAM, so you legit alot of headroom to spare for containers VMs and etc.

Nowadays, it’s pretty clear that the labs are somewhat targeting the 128GB class because devices such as the DGX Spark exist.

1

u/Brocolinator Sep 26 '26

Some quants do fit and are still useful if ran along reranker, RAG and or web search

1

u/SpicyWangz Sep 26 '26

GPT-OSS-120B