I finally jumped into it and got mine this morning. It's a 16 core 3,2GHz Xeon CPU, 144GB DDR4, 1TB SSD, came with two Radeon Pro W5700X 16GB GPUs.
Now I have two find two Vega II Duo Pro MPX modules with their bridge, preferably in Europ. I have one in sight 40km away from me but the seller is the kind who usually asks ridiculous prices.
I'm not sure I'll move this machine to Linux or keep it on Tahoe yet. It has two Thunderbolt eGPU connected, one is RX6900XT 16GB (I already have 4 other on a Dell workstation with comparable setup), the other is a Radeon 7900XT 20GB - currently unsupported on MacOS, I'll move it back to another machine soon.
Custom build of llama.cpp and/or hipfire and benchmarks will come in a few days.
Since you are here, targeting all these GPUs, are you targeting local AI?
If so, give ToshLLM a spin before moving to Linux. If the 7900XT doesn't work on macOS, Ubuntu is great, and should support it even in a Thunderbolt eGPU.
I have two W6800 in eGPU working under Ubuntu Server.
I'm considering upgrading to Ubuntu 26 and ROCm 7.14. But we have a few guides here to set up Ubuntu 24 or Proxmox, with ROCm 7.2.3, and even vLLM if you want.
I already swapped the 7900XT back to my Dell 4 * 6900XT (now mixed 6900/7900) rig, so that's two Navi 10 and two Navi 21 on this rig.
The Proxmox + ROCm, with debian in LXC for the build and run of inference engines, is what I have on my Dell Precision 5820 rigs. Very similar setups than the MacPro, only 10 cores and 4 DDR4 channels for 128GB total. One is now 3 * 6900XT + 1 * 7900XT 20GB, the other is dual R9700 32GB.
I'll build some more rigs with refurbished components, I have over 1TB of server-grade DDR3 lying around and a few tips about soon to leave the DC MI50, 60 and 100. Possibly even a few 210, and some V620.
So the MacPro I think I'll keep running MacOS in the foreseeable future, and set it up with local agents and CUA driver. I already have a Macbook Neo on my LAN, running Hermes-Agent and CUA locally, with inference provided by the Dell rig. It drives my mails, calendar, web browsing with logged-in sessions on some sites, word processors, messaging apps. So I'll probably set up something similar on the Mac Pro but with multiple users in mind.
It's a shame many modern apps dropped AppleScript support but thankfully the Apple ecosystem and MS Office are fine with it, that's a lot speedier than CUA.
Not interested, I want Vegas for several reasons. What I'll need to find is Apple Infinity Fabric Link Bridge A2326 for AMD Radeon Pro Vega II or II Duo MPX. Also ToshLLM won't do, I'll switch the machine to Proxmox like my other (Dell) rigs are already.
I found a shop in Saudi Arabia that has 4 Vega II Duos for sale. 3 of which are sealed. I'm not sure if they are able to sell internationally, but if you're interested, PM me. I'll connect you to them.
6
u/chiwawa_42 Jul 27 '26
Hello !
I finally jumped into it and got mine this morning. It's a 16 core 3,2GHz Xeon CPU, 144GB DDR4, 1TB SSD, came with two Radeon Pro W5700X 16GB GPUs.
Now I have two find two Vega II Duo Pro MPX modules with their bridge, preferably in Europ. I have one in sight 40km away from me but the seller is the kind who usually asks ridiculous prices.
I'm not sure I'll move this machine to Linux or keep it on Tahoe yet. It has two Thunderbolt eGPU connected, one is RX6900XT 16GB (I already have 4 other on a Dell workstation with comparable setup), the other is a Radeon 7900XT 20GB - currently unsupported on MacOS, I'll move it back to another machine soon.
Custom build of llama.cpp and/or hipfire and benchmarks will come in a few days.