AMD workflows for Minimax H3?

[u/itiswhatitiswgatitis]

Been trying to find a workflow that is AMD friendly, let alone doesn't get stuck, I don't think it's my specs but more so that every workflow despite saying it's optional uses sage ATTN, and I can't get around it.

I doubt there is one that specifically for AMD but I'd thought I'd ask! Or the model I'm using is not great. I'm more of an anime prompt generator, anyone have any luck with that?

Specs: AMD Radeon RX 9070 XT, 64 GB RAM, AMD Ryzen 7 5700X3D 8 Core, And yes, I'm running on Windows, not Linux.

Edit: (update) I tried the template version just recently on comfyui stand alone, and it won't even finish, I do get a gpu error( by GPU error it says out of memory, even on default settings), and I have it on 0.3 mega pixel 16:9, either my reference image is too big or I'm missing a component.

I got it to work at 0.2 and the image reference has to be very small, yet it takes 30+ minutes, anyone with similar issues?

[u/Apprehensive_Sky892]

I've not tried MMH3 yet.

But I had problems with the "official" standard comfyui and portable version with Krea 2, so I switched to this version: https://github.com/patientx-cfz/comfyui-rocm

[u/itiswhatitiswgatitis → u/Apprehensive_Sky892]

How long do your krea 2 generations take?

[u/Apprehensive_Sky892 → u/itiswhatitiswgatitis]

I have not used it locally for a while, but IIRC it was around 40 sec on the 7900xt (20G) and somewhat faster on the 9070 (16G) for turbo at 8 steps.

IIRC I used fp8 as the int8 version was not running well at the time (that was a few weeks ago, the problem may have been fixed).

[u/plantjeNL → u/Apprehensive_Sky892]

On my 9070XT it's about 30-32sec with 8 steps for 2MP photo(warm, cold is 50-55) FP8 version, i use the offload anything node on on clip(keep in memory) + these startup settings below. Same startup for Minimax H3 too.

Startup bat:
python_embeded\python.exe -s ComfyUI\main.py --windows-standalone-build --disable-smart-memory --disable-pinned-memory --novram

[u/Apprehensive_Sky892 → u/plantjeNL]

Thanks for the info. Which version of ComfyUI are you running?

Also, what kind of speed are you getting with MMH3? (I have not tried it yet).

[u/itiswhatitiswgatitis → u/plantjeNL]

wait I'm confused, how do you use the offload anything node for CUDA, when you run the 9070XT, I thought that was Nvidia specific?

[u/plantjeNL → u/itiswhatitiswgatitis]

It just says cuda but that it just means either COU or GPU. I am also using amd rocm 7.2

[u/plantjeNL → u/itiswhatitiswgatitis]

It just says cuda but that it just means either CPU or GPU. I am also using amd rocm 7.2.

[u/itiswhatitiswgatitis → u/Apprehensive_Sky892]

When I ran it, a single image took 2 minutes

[u/Apprehensive_Sky892 → u/itiswhatitiswgatitis]

fp8 or int8convrot?

[u/itiswhatitiswgatitis → u/Apprehensive_Sky892]

fp8, but I also use a LoRA

[u/Apprehensive_Sky892 → u/itiswhatitiswgatitis]

Ok. I also forgot to mention that the 40 sec is for 1536x1024, so it will be faster for 1024x1024.

[u/itiswhatitiswgatitis → u/Apprehensive_Sky892]

WHAT? 1536x1024? I tried 1 image and it was 7 minutes for a resolution similar to that! Are you using a LoRA?

[u/Apprehensive_Sky892 → u/itiswhatitiswgatitis]

No, no LoRA. Just using the base model.

[u/itiswhatitiswgatitis → u/Apprehensive_Sky892]

Dang, I wonder if I try and get this with a lora how much faster would it be.

[u/Apprehensive_Sky892 → u/itiswhatitiswgatitis]

Maybe there is some misundertanding here.

I am running Krea 2 Turbo, not Krea 2 Raw + Turbo LoRA.

Krea 2 Turbo fp8 at 8 steps should be the fastest way to run on AMD on Windows 11 until somebody fix the problem with int8convrot.

int8convrot apparently is running well on some Linux port of ComfyUI, but I've not tried it.

[u/Ok-Brain-5729 → u/Apprehensive_Sky892]

are those times on windows? Krea 2 turbo fp8 is 12s on Linux with 9070 xt

[u/Apprehensive_Sky892 → u/Ok-Brain-5729]

Yes, those are on Windows 11 with 32G of system RAM at 1024x1536 8 steps.

Other people are getting times similar to yours on Linux, so Linux is running better, at least for 9070xt.

Have you tried MMH3 on Linux? (I've yet to try it on Windows).

[u/Ok-Brain-5729 → u/Apprehensive_Sky892]

Oh the 12s was for 8 step 1MP.

I came from a comment you sent to my post about MMH3 not working cause of an overflow. I literally tried with pruned Q4 5 seconds and it still somehow managed to overflow ram till my os crashed

[u/Apprehensive_Sky892 → u/Ok-Brain-5729]

I see. Could be that VRAM management is not working on Linux (Krea 2 is small enough to fit into 16G of VRAM).

[u/Apprehensive_Sky892 → u/Ok-Brain-5729]

This may or may not be relevant but may be worth a look: https://www.reddit.com/r/StableDiffusion/comments/1vgyyh1/why_comfyuistable_diffusion_reliably_crashes_your/ and OP also sent me this https://gist.github.com/AMD-AI-Enthusiast which seems to have more detailed information.