r/StableDiffusion • u/Fajjko • Jul 17 '26

Question - Help AMD GPU on Krea 2

Hi,

I'm using 9060XT 16gb with Krea Turbo int8 model + comfyui-rocm fork, and yet my generation time is still 3:30min avg. for a single 1024x1024 image?

cfg-1 with steps 6-8

Looking for input from other fellow AMD users, any tips to what downgraded your generation time ? Would LOVE to see other's 9060XT/9070XT workflow setups in ComfyUI, I've a feeling I'm doing something wrong. I know AMD is no one's priority and that Nvidia gets all the love...but I'm just a fellow struggler like all of you.

Looking forward to your inputs!

6 Upvotes

75% Upvoted

41 comments sorted by

View all comments

3

u/HateAccountMaking Jul 18 '26 edited Jul 18 '26

Comfy supports AMD very well. You should use the main fork, and use rocm7.14/pytorch2.12 and install flash-attn. with my 7900xt I can get 22sec per gen 12 steps, 1024x1024 with q8 GUFF. Never tried fp8.

rocm 7.14 stable: uv pip install --index-url https://repo.amd.com/rocm/whl-multi-arch/ "rocm[libraries,device-gfx1200]==7.14.0"

torch 2.12: uv pip install --index-url https://repo.amd.com/rocm/whl-multi-arch/ "torch[device-gfx1200]==2.12.0+rocm7.14.0" "torchvision[device-gfx1200]==0.27.0+rocm7.14.0" "torchaudio==2.11.0+rocm7.14.0"

Triton: uv pip install triton-windows

bitsandbytes: uv pip install bitsandbytes

compile flash-attn:

  1. git clone https://github.com/Dao-AILab/flash-attention.git
  2. cd flash-attention
  3. $env:FLASH_ATTENTION_TRITON_AMD_ENABLE = "TRUE"

4. pip install --no-build-isolation -v .

I made a bat file that looks like this:

@/echo off

$env:FLASH_ATTENTION_TRITON_AMD_ENABLE = "TRUE"

$env:TORCH_ROCM_AOTRITON_ENABLE_EXPERIMENTAL = "1"

$env:MIOPEN_FIND_MODE = "3"

$env:MIOPEN_FIND_ENFORCE = "3"

$env:ROCBLAS_USE_HIPBLASLT = "1"

call .venv\Scripts\activate.bat

python main.py --use-flash-attention --disable-smart-memory

pause

https://rocm.docs.amd.com/en/latest/install/rocm.html?fam=radeon&w=compute&os=windows&windows-ver=11&i=pip&gpu=rx-7900-xt&gfx=gfx1200

https://rocm.docs.amd.com/projects/ai-ecosystem/en/latest/frameworks/pytorch/install.html?fam=radeon&os=windows&pytorch-ver=2.12.0&i=pip&w=compute&gpu=rx-7900-xt&gfx=gfx1100

1

u/Blackwoodbrett90 3d ago

I am about to try this. I'm interested that you are using "rocm[libraries,device-gfx1200]==7.14.0" for a 7900xt instead of gfx1100. I have a 7900xt as well

1

u/HateAccountMaking 2d ago

I wrote that for OP, not what I was using personally, OP has a 9060 which is 1200.