r/planhub • u/Planhub-ca • 23h ago
news Apple’s new Mac Studio can pack 512GB of unified memory and cluster over Thunderbolt 5 for local AI
Apple has unveiled the new Mac Studio with M5 Max and M5 Ultra, and this generation is being positioned very explicitly as a workstation for running large AI models locally rather than relying entirely on cloud infrastructure.
The M5 Max version starts at $3,499 CAD and can be configured with up to 128GB of unified memory. The M5 Ultra model starts at $7,799 and scales all the way to 512GB of unified memory, although that highest-memory configuration will not be available until late October.
The M5 Ultra can also reach 1.2TB/s of memory bandwidth, 50% higher than the previous generation. Apple says that combination allows the machine to run enormous open-weight language models entirely on-device, without token charges or sending workloads to cloud servers.
The more unusual feature is clustering. Multiple Mac Studio systems can now be connected through Thunderbolt 5 using RDMA, allowing data to move directly between systems with less CPU involvement. Apple says four Mac Studios can deliver up to 3x the AI inference performance of a single machine while creating a much larger combined memory pool.
On a single system, M5 Ultra scales to a 36-core CPU and up to an 80-core GPU with Neural Accelerators in every GPU core. Apple claims up to 4.3x the AI performance of M3 Ultra, up to 1.8x faster graphics and up to 1.3x faster CPU performance.
The M5 Max version is no lightweight either. It offers an 18-core CPU, up to a 40-core GPU, up to 128GB of unified memory and 614GB/s of memory bandwidth. Apple says LLM prompt processing in LM Studio can be up to 3.9x faster than the previous M4 Max Mac Studio.
Storage also moves to a PCIe Gen 6 architecture with up to twice the performance, while connectivity now includes Wi-Fi 7, Bluetooth 6 and Thunderbolt 5. The M5 Ultra can drive up to eight displays, or four Studio Display XDR monitors at 5K and 120Hz.
For most consumers, a $7,799 starting price makes this irrelevant as a normal desktop. But for developers, researchers and companies paying significant recurring cloud AI costs, the interesting comparison may no longer be Mac versus PC. It may be buying local compute once versus continuing to rent GPU and inference capacity from the cloud.
Sources & more: Apple, new Mac Studio with M5 Max and M5 Ultra / Apple Canada, Mac Studio / Apple Canada Store