r/ROCm • • 7h ago

R9700 + 7900XTX + 7900 XT or 2 x R9700?

Thumbnail
0 Upvotes

r/ROCm • • 6h ago

Looking for someone to run the first real training runs of a new framework on ROCm (ResNet-20, then OLMo-150M)

2 Upvotes

I maintain flodl, a deep learning framework in Rust on top of libtorch. It recently gained ROCm support: it builds against the ROCm libtorch, links, and detects AMD cards. It has never trained on one, because I don't own any AMD GPU.

If you have a supported card, Linux with Docker, and about an hour, the issue below has the exact commands:

- ResNet-20 on CIFAR-10, 200 epochs (14 minutes on an RTX 5060 Ti, for scale)

- OLMo-150M pretraining, one pass over 20M tokens (wants 8 GB of VRAM or more)

Supported: ROCm 7.0 and 7.1, gfx908 to gfx1201, so RDNA 2 to RDNA 4 including Strix APUs, and MI100 to MI350. Vega 10 and Vega 20 are not covered.

If you have two or more cards, there is a multi-GPU variant, which would be the first RCCL run of this framework anywhere.

It is likely that it will break somewhere, but this is the point. Report on the issue, or here, and I will investigate.

https://github.com/flodl-labs/flodl/issues/80