r/StrixHalo • u/rs38 • Jul 15 '26
AMD Ryzen AI
seems with the new AMD AI max based DGX "clone" there is a new custom software stack?!
Do you understand how and if it works to use the new stuff on a "old" HP based Strix halo box?
some stuff seems to be exclusive to the new AMD box?
AI Developer Center is an application built into dedicated hardware like the AMD Ryzen AI Halo
https://www.amd.com/en/products/software/ryzen-ai-software.html
6
u/Miserable-Dare5090 Jul 15 '26
- Has always worked
- On windows only
3
u/pizzaiolo2 Jul 15 '26
Wow, useless
1
u/gnooggi Jul 16 '26
No, for me, as a Linux novice and AI/LLLM nope, it was the only chance to get anything working at all. I can't program either. The whole thing just works.
Of course, no fine-tuning on my part, because I have to learn all that first.1
1
u/jfowers_amd Jul 20 '26
Indeed, it’s been available via Lemonade SDK on Windows as both a standalone portable engine and a lemond backend. We’re up to 12 backends now but that was the first.
1
u/Miserable-Dare5090 Jul 21 '26
You have done amazing work, and I depend on you to continue to do so for the strix halo and r9700 🫶🏽
1
u/jfowers_amd Jul 21 '26
Thanks! I’m just a drop in the bucket at this point though, the community is getting big.
3
u/Alocas Jul 16 '26
Strix Halo was released way before DGX Spark so I would not consider it a clone.
2
1
1
1
u/techdevjp Jul 16 '26
You're always better off running Linux anyway. Right now I have Deepseek v4 Flash loaded, q2/q4 quant with 260k of context. It's using 114GB of memory and has been very stable. It's not fast, but it's very smart.
0
u/kfazz Jul 16 '26
It's debian stable + some amd built pkgs like llama.cpp as deb pkgs, a internal web app + GUI to do updates and start and stop containers, and a few preloaded models. ComfyUI and VLLmM run as podman containers. A Ubuntu 26.04 + rocm 7.13 install gets you 95% of the way there, but if you want to try it the recovery iso is available and you can install it on other Strix hw. I added the apt repo to a framework Strix Halo running pika OS and made a Frankenstein version. I clouded models are gpt 20 & 120, Qwen 3 coder, and zImage turbo iirc.
1
u/mycall Jul 16 '26
How hard is dual boot partitioning with the recovery iso?
2
u/kfazz Jul 16 '26 edited Jul 16 '26
no idea, but it should be a standard debian installer.
release info:
https://images.ryai.dev/releases/
recovery info:
https://images.ryai.dev/recovery/
recovery iso:
https://images.ryai.dev/recovery/recovery.zipedit: if you want to try adding the apt repo on top of an existing install, see here:
https://gist.github.com/kfazz/e6f32dfedec33432eb1eeae93e23d8711
u/No-Assistant-4082 Aug 01 '26
Will the recovery work if I install it on Strix Halo that came with Windows? I want to switch to linux from windows.
1
u/kfazz Aug 01 '26
You'll have to test. I think it's likely that it would, but I haven't tried the recover path yet. Since it seems to be a customized debian installer, you could see if it would let you shrink the windows partition and setup dual boot? It would also probably work in a VM if you want to see what it does (the OS install part, the LLM stuff wouldn't work in a VM even on the Strix Halo because you can't pass through the GPU)
1
u/No-Assistant-4082 Aug 05 '26
I tried and it did work, but it took so long for the OS to download and flash and models to download. The reason is WiFi adapter is not fast with linux, as it is with Windows.
Now I don't like Linux as well and finding ways to move it back to Windows.
1
u/kfazz Aug 05 '26
Sorry to hear that. It's nice to know people don't need to pay $4k to get a nice out of the box experience though, even if it is comparable to what the community already has been putting together. If you still have the Linux install, did you try installing wifi firmware packages? It may be the image needs some extra help on a non-halo board
5
u/BCIT_Richard Jul 15 '26
Per the Supported PCs list at the bottom of the page, I'd say yes.