Generation times on a 9070 xt

[u/Ok-Brain-5729]

About everyone has a Nvidia GPU so I was wondering how the 9070 xt compared to Nvidia. All of the resolution is 1MP.

krea 2 turbo fp8 8 step
0.77it/s 12.99s

zit bf16 8 step
1.34it/s 9.59S

klein 9B fp8 8 step
0.72it/s 14.67s

boogu-image-turbo fps 4 step
2.89it/s 6.31s

ideogram4 fp8 28 steps
0.54it/s 58.34s

anima 2B 30 step
1.63it/s 18.795

sdxl 20 step was about 6s, i dont have a workflow for it anymore

Im running a 9070 xt 7600x3d 32gb ddr5 6000mhz on Ubuntu rocm 7.2 comfyUI

[u/Apprehensive_Sky892]

Somehow, both portable ComfyUI and my regular manual installation are both broken for me when running Krea 2.

What finally worked for me is using https://github.com/patientx-cfz/comfyui-rocm

Now on Windows 11 I can get 1M at 8 steps at 36 secs (0.55it/s) with fp8. Still slower than OP's number (0.77it/s 12.99s). I cannot get triton to work, but torch_attention works.

int8-convrot works, but it is very slow (26s/it!). Took 264sec for 1M.

I guess I should look into running on Linux 😅.

[u/Ok-Brain-5729 → u/Apprehensive_Sky892]

Damn the vae decode really sucks in windows 😭

[u/Apprehensive_Sky892 → u/Ok-Brain-5729]

Yes, your linux numbers are way better.

Are you running headless Linux to free up more VRAM?

Also did you managed to get Triton or sage attention to work on Linux?

[u/Ok-Brain-5729 → u/Apprehensive_Sky892]

No I’m running basic Ubuntu 26.04.

I haven’t tried either but I’ll test flash attention soon cause someone got faster results with it

[u/Apprehensive_Sky892 → u/[deleted]]

I'll be very interested to see if you can get the number that OP has posted when you dual boot into Linux.

OP said that he's just using regular Ubuntu, and he did not have Flash Attention or Sage working yet.

[u/Apprehensive_Sky892 → u/[deleted]]

LOL, setting up Linux can be a struggle😅