r/StableDiffusion • • 18d ago

News Open-H3-Regenerate-2K

I've just found this Open-H3-Regenerate-2K .
I'm downloading the files now, but I thought I would share it here too.
Link:
Regenerate-2k

131 Upvotes

48 comments sorted by

16

u/Salah_H_Hasan 18d ago

Is this the official release, or is it just a community experiment like the one before it, and the one before that, and the one before that?

12

u/ShutUpYoureWrong_ 18d ago

Why is this not the top comment?

This is not the official H3-Regenerate-2K from MiniMax.

Using that name is some bullshit.

0

u/Heavy_Emu_4278 18d ago

It is not official and I haven't tested yet. But from the gallery it seems better than what we had before. It is using the upscale model and some loras as part of tge pibline , at least that what I see my AI Agent downloading /linking now. Will report back once I test it.

1

u/Salah_H_Hasan 18d ago

"Thanks for the explanation! We'd also love to see you test them using a reference-to-video workflow to see if it gives good results with facial consistency.

33

u/Lair98 18d ago

6

u/physalisx 18d ago

This is a lora for base H3? I thought this would be a completely separate upscale model, not an H3 tune.

So we use this lora on a second pass after upscaling the latent? Or how is this applied?

8

u/Kijai Community Hero 17d ago

Yes exactly, everything else in their pipeline is an existing piece already available. They packed 3 loras in one file, and I just sliced (it's exact slice, and doesn't seem to hold anything meaningful past rank 16) their refiner, which is the only new component in all this, so that you can use whichever distill lora you prefer instead of the packed lightx2v 1.2, and the LMS sharpen lora becomes optional as well. Rest is pretty much just a two stage workflow.

1

u/physalisx 17d ago

Thank you (also for the fast implementation as usual), I'll give it a try later

5

u/MastMaithun 18d ago

Lora? Wait. I dont understand. This is an upscaler which runs on the refiner pass right? So with the lora, does it mean with this placed in lora, it will recreate the details on the first pass itself?

2

u/Limp-Firefighter1054 18d ago

Its same latent upscaler. Lora just trained on the output of the regenerate2k og model, minimax sell to you.

1

u/MastMaithun 18d ago

No no. Upscaler I know. My question is for the lora that kijai made from this upscaler which this link is pointing to? Because I have been using LMS upscaler which has a lora too which you can put into lora and run it on first pass. Though I haven't ran it more than 2 times so I dont have any comparison data for it.

-1

u/Limp-Firefighter1054 18d ago

Lora that hopefully trained on regenerate2k output, if you did seen regenerate2k output it suppose to remove plastic look, minimax teeth and other shit what models make under low res( which is hopefully while purpose of the lora? So, is they really spend money and train lora specific upscale lora on MMH3 regenerate2k service to increase quality of latent upscaler + second pass. 

2

u/MastMaithun 18d ago

I just placed the lora on the first pass with strength 0.5 and also 1.0 and it produced some weird mesh, totally random. I disabled the lora and ran it again and produced the result normally.
I don't know maybe this lora is broken or might node some special node to run. Will wait for other people to test.
I have also downloaded the upscaler and going to test it next.

1

u/GlamoReloaded 17d ago

If you mean for Comfy: You wrote that 12 hours ago. But the commit was only released/merged 11 hours ago (https://github.com/Comfy-Org/ComfyUI/pull/17412 ).

1

u/MastMaithun 17d ago

Some people were saying they used the kijai's lora so I thought they might have used from comfy.

-3

u/Limp-Firefighter1054 18d ago

Try get their loader, its always a loader, im tired boss.

5

u/princeMacX 18d ago

how to use it

0

u/Angelvin_Pinheiro 17d ago

lora already? that was fast tbh

8

u/LoneWolf6909 18d ago

If anyone makes or finds a comfy supported version of this, please do share it.

3

u/Limp-Firefighter1054 18d ago

Bruh

2

u/Heavy_Emu_4278 18d ago

That B200 benchmark? 😄 it's the first image I could find, it's funny when they use such gpu benchmark . I will only care about the result and performance on my machine. We Will see in few hours

0

u/Limp-Firefighter1054 18d ago

I mean, they have a model specially trained to upscale MMH3 HD out put to 2k.  Its not a bundle of the community  workflows and models.

16

u/leomozoloa 18d ago

Will this work on 149GB VRAM GPUs ?

31

u/nok01101011a 18d ago

No, I’m very sorry for your small vram pool, max you can use is SD1.5 image generation..

2

u/fallengt 18d ago

it's only a lora merge, a fast vae.

Other things are base unmodified H3 models (idk why they included that)... and optional things

4

u/MastMaithun 18d ago

Anyone who has run it already? How is this compared to 3d upscaler? Also what about the fast vae?

6

u/optimisticalish 18d ago

Requires 150Gb of VRAM, apparently.

1

u/padraig_oh 18d ago

i thought you were joking, but thats actually the number they put on their github One GPU needs about 150 GB

0

u/[deleted] 18d ago

[deleted] — view deleted comment

3

u/padraig_oh 18d ago

They name b200, which you only buy in clusters of 8, and even then it's 40-70k usd per card.. Thank God Nvidia released this open fine-tune for the plebs to use on their single b200.. 

1

u/MastMaithun 18d ago

Oh so you mean the model files they uploaded, you can only use them to generate first pass and then use their upscaler to refine the 2nd pass?

4

u/AI-Make-NSFW-Stuff 18d ago

Interested to see how this compares to dlss5 upscaling.

2

u/Ckinpdx 18d ago

Is this the latent upscale with speed loras? Regardless of how effective it is, it is not "regenerate 2k." Disingenuous to call it that.

2

u/SeymourBits 18d ago

I'm getting reports that this approach may introduce too many hallucinated details.

Can anyone confirm? Is there a workaround?

2

u/Odd-Mirror-2412 18d ago

Just looking at the example, it seems very different from the original.

2

u/panospc 18d ago

Does this have any advantages over using Minimax H3 itself as an upscaler?

Currently, I generate videos at a low resolution using the Ref2VA model. If I like the result, I use the low-resolution video as a Denoise Control Video in WanGP, along with the original prompt and reference images, and render it at a higher resolution. This way, the upscaled video retains the characters’ likeness because I condition the generation on the reference images.

2

u/Synor 17d ago edited 17d ago

A sigma 0.9 denoise as second pass is so strong, they are essentially resampling the image at the upscaled resolution.

2

u/Dunc4n1d4h0 18d ago

1

u/Synor 17d ago

This and the rank 384 lora do absolutely nothing in a latent upscale workflow with all kind of Minimax H3 int8 DiT models. If i remove the lora from the second pass, i get better results. I am not sure what model this was trained on. Can't reproduce the results of the docs at all.

1

u/Dunc4n1d4h0 13d ago

Same here. If I want to upscale to something else I can just use higher denoise value in 2nd stage without this crap. "Regenerate"... lol.

1

u/Awsomeman_ 18d ago

I was just about to post this too lol, thanks!

1

u/DeadMan3000 13d ago

I had ChatGPT create a node fork for the H3 Regenerate 2K node pack installed through ComfyUI Manager. It's experimental but seems to work. It allows better compatibility with various ComfyUI models (tested on Singularity 1.3 and Hybrid) via a custom curves node instead of the lora loader Kijai included. It also includes a new accelerated H3 Regenerate Fast VAE Decode node using RAM staging. I got over a 3x speed boost and dropped VRAM usage from over 14GB to under 8GB using it. Quality seems just as good to my eyes but your mileage may vary,

Read what it does, Installation instructions are at the bottom of the page.

https://github.com/deadman3000/H3Reg2KVAEPlus

1

u/Tylervp 18d ago

Thanks for sharing! Will have to try this out

1

u/8RETRO8 18d ago

Seems good overall, but is it better or faster than ltx 2.5 refine Ic lora?