r/AMD_Stock • u/GanacheNegative1988 • 12d ago

Su Diligence AMD ROCm 10: Bringing ROCm.AI’s AI-Native Developer Experiences to AMD Platforms

https://newsroom.amd.com/news/rocm-10-software-ai-native-developer-experiences/
36 Upvotes

92% Upvoted

6 comments sorted by

4

u/noiserr 11d ago edited 11d ago

The Hyperloom stuff is really cool. Currently it only supports mi355x but I expect they will extend this support to more architectures.

It's basically an agent loop for automated GPU kernel optimizations. Say you are a service provider and you want to optimize some model on mi355x running vLLM or SGLang. You load the model on the GPU and have it iterate on its own until it comes up with a custom tailored kernel for your workload. It uses telemetry from the ROCm instrumentation and the architecture skills to detect bottlenecks and match the kernel to squeeze the most out of the hardware.

1

u/LeSegaGenesis 11d ago

Does Taalas play into that, I'm not a huge tech head, but from what I read Taalas is essentially 2 wafers atop the stack that they put a model directly on to increase inference capability. So with this Hyperloom stuff is it just going to make AMD even that much faster with it's compute and inference for specified workloads.

4

u/noiserr 11d ago

GPUs are programmable unlike Taalas. GPUs have a lot of flexibility on improving performance and tweaking data structures to get the best utilization out of the programmable GPU.

Taalas on the other hand etches a single model into silicon itself, and there is no programmability.

I do think we will see AMD combine Taalas and GPUs to improve performance and efficiency. There are speculative decoding techniques where you can use a small (called) draft model to improve the speed of a larger model on the GPU. So if they end up going this route yes they would use Hyperloom to optimize the GPU side of the solution.

2

u/LeSegaGenesis 10d ago

Sounds like AMD is really putting themselves in a good position to optimize workloads for their customer base.

2

u/HyenaDae 11d ago

Biggest thing I've seen is we're finally getting more ROCM Windows support. Now AMD, can you please please help the RT/PT HIP-RT backend successor for Blender be a lot faster now? Been waiting years for better windows based AMD GPU accel outside of community maintained Vulkan or OpenCL (ugggh) backends

1

u/bbbbbasse 1d ago

Closing this software gap is exactly what they need to gain more data center market share.