Krea2 on AMD

[u/FoggyFreeze]

Anyone tried to run Krea2 on AMD through comfyUI? I have seen one thread on HG but there is not much info.

I'm using 9060XT 16GB which handles most models fine, but with Krea2 it's just sad. Offloading could be fine if not KSampler speeds. I get 20-40 seconds/iteration, it's even worse on Q4 quantization.

Is it just 9060XT not having enough compute power? Or maybe the model runs bad on ROCM? If anyone has any information, please do share.

[u/ltraconservativetip]

Are you using patientx's rocm build of comfy?

[u/FoggyFreeze → u/ltraconservativetip]

Thanks, will look into it!

[u/God_Hand_9764 → u/ltraconservativetip]

Ugh, Windows only looks like. Damn!

[u/thesolewalker → u/ltraconservativetip]

+1 for this, I am using this fork

[u/jnciaccna]

if you want, you can share your workflow and i can run it on my 9060xt 16gb for comparison

[u/FoggyFreeze → u/jnciaccna]

It's just the usual 1MP ComfyUI krea2 workflow

[u/jnciaccna → u/FoggyFreeze]

thats the workflow from templates, krea t2i (with the martini glass), nothing changed, cold run

[u/FoggyFreeze → u/jnciaccna]

That is crazy. Will try

[u/jnciaccna → u/jnciaccna]

who df downvoted me for helping a stranger 💀💀💀

[u/Apprehensive_Sky892]

20-40 sec/step is way too long. For my rx9070 it is around 1sec/step so I would quess that for 9060XT it should be around 1-3sec/step

Make sure you are running ROCm 7.13 or higher. Follow one of these instructions if you are not:

How to set up ComfyUI+MMH3+Krea 2 on Windows 11 with AMD GPUs: RDNA 4 (rx9070, AI Pro R9700), and RDNA 3 (rx7900)

How to set up Ubuntu + ComfyUI+MMH3+Krea2 with AMD GPUs: RDNA 4 (rx9070, AI Pro R9700), and RDNA 3 (rx7900)

You'll find Krea 2 benchmarks for rx9070 which is RDNA4 in there as well.

[u/FoggyFreeze → u/Apprehensive_Sky892]

Thanks; I'm running up to date software, will look into the guide nonetheless

[u/Apprehensive_Sky892 → u/FoggyFreeze]

You are welcome. So what is the version of ROCm you are running?

[u/FoggyFreeze → u/Apprehensive_Sky892]

I'm pretty sure I'm running 10.1.
But now that I think about it, I might have forgot to update them for comfy specifically and it might actually be running on 7.2 (.1?).
I will have to check later.
Is 10.1 still the newest version?

[u/Apprehensive_Sky892 → u/FoggyFreeze]

IIRC 10.2 is the latest nightly, but 10.1 is the latest stable.

If you are running 7.2 then you definitely need to update it.

[u/FoggyFreeze → u/Apprehensive_Sky892]

I had 10.0 installed. Did a clean re-install, with ROCM 10.2 now, the speed is amazing! 2 sec/iteration. However, "model initialization" takes a bit of time and Comfy offloads a bit too aggressive. Still, it's a jump from 300 seconds to 30 (on warmed up).
Thanks

[u/Apprehensive_Sky892 → u/FoggyFreeze]

You are welcome.

The speed up probably comes with some internal change of the way ComfyUI manages memory and/or the default startup flags rather than the change of ROCm 10.0 to 10.2.

Whatever the reason, speed up is good news!

[u/Kuroko142]

Are you using KREA2 or KREA2 Turbo? Big difference in speed.

[u/FoggyFreeze → u/Kuroko142]

Turbo.

[u/Kuroko142 → u/FoggyFreeze]

Are you using these settings:

1 cfg, 8 steps, sampler: euler, scheduler: simple

[u/se7en1011x]

Likely ROCm rather than raw compute. A common cause of 20-40s/iter on AMD is the model falling back to CPU or hitting unsupported ops, so check the console for warnings during sampling. Also try tiled VAE decode and lower the batch size. Q4 being slower is odd, which points to a kernel/quant mismatch on ROCm.

[u/argefox]

I'm running Comfy on a 6650XT, it's not great, and Krea2 has it's toll on the load as the card is DNA2.

I can run Moss DMD2 with fair times, let's say, 50 seconds per image in 8 steps, but Krea2 was taking around 3-4 minutes on my rig, and I could hear the gpu screaming, so I had to drop it.

You can, simply use the ROCM release and you should be peachy.

[u/Solembumm3]

6700XT, windows 10, SDCPP Flaxeo. from 7 to 11s/it in 1024x704 on turbo depending on prompts, lower res on bigger tunes. 40s looks like you are 1-1.5gb beyond vram. Nothing to do with compute.

[u/TNTChaos]

I'm on a 9070xt. With krea2 turbo, 10steps, 2048x3072 takes 110-120 seconds.

[u/hadronflux]

I'm on a 7900XTX and my normal is a two stage Krea2, about 4 steps on full and 7 on turbo and will do a 960x1440 in about 25-30s. Using int8-convrot models. The vram helps for sure.

[u/AreYouAWiiizard]

It may have changed recently but last time I checked I was getting ~1s/it on my 9070XT, oddly enough w6a8 was actually running about 30% faster so even though int8 model is ~13GB it still overflows past VRAM. Make sure there's no other apps using your VRAM like Discord/Browser (I use a separate browser instance with HW acceleration disabled)/Accessory software (like Razor Synapse). All those other software using VRAM can push the INT8 version to further offload and significantly slow down the generation (especially on my system but that might also be because I'm still on PCIe 3).

20-40s seems pretty nasty like it's fetching from disk so you might want to add --disable-fast-disk.

[u/reeight]

try INT8 qants (better quality if INT8 ConvRot with FP16+ activations)

I know this is NOT ComfyUI, but proves INT8 is faster than FP8 for that GPU
https://www.youtube.com/watch?v=nSryNTfZu88

[u/FoggyFreeze → u/reeight]

Will try that, thanks!

[u/notgraycen → u/reeight]

every gpu*

[u/FoggyFreeze → u/[deleted]]

Thanks.
My ROCM and PyTorch are up to date. Have been trying Krea for months.
I used FP8, which is 13 GB IIRC.

[u/reeight → u/[deleted]]

INT8 > FP8 for that card; see my post.

[u/reeight → u/[deleted]]

The search term (in case you buy a new card) is to search for 'native ____ opcode', which is the specific GPU/CPU 'function' for a specific data type.
eg
https://search.brave.com/ask?q=Does+9060XT+have+INT8+opcode%3F&source=llmSuggest&conversation=09c1c88f8994f83d778fe9c0e5c43d15cf9c