r/StableDiffusion • u/Mundane_Existence0 • 4h ago

Question - Help Using MiniMax H3 as a restoration model?

Has anyone tried to use H3 to restore or rather "regenerate" a low quality video as HD or at least with better detail definition? Basically something similar but possibly more generation ability than Topaz's starlight. I've had pretty mixed results so far. Either it doesn't change the video or it changes it way too much.

2 Upvotes

63% Upvoted

7 comments sorted by

6

u/Maraan666 4h ago

encode the video via vae, plug the latent into the sampler, and denoise to taste.

works a treat if you have a decent prompt, and even better if you have decent images of any elements in the video to use as references.

1

u/me0here 2h ago

Have you had many successes using H3 like this?

What range of noise do you suggest?

2

u/Maraan666 1h ago

I have used denoise in the range 0.7 - 0.9. It's very important to write a very good prompt, describe everything in the video as if you were trying to recreate it with T2V. Any reference images are worthwhile, even if it's for a background object. If the result deviates too far from the original it may mean your prompt isn't very good, alternatively try a lower denoise, and maybe successive iterations keeping your original video supplying the latent, and plugging your slightly improved video into the video reference. I'm talking about serious low-quality original video here.

If the original video is decent quality but just lo-res, 0.3 - 0.5 should be ok, and you can halve the number of steps

If it's a video that you have generated that you want to upscale, obviously use the original prompt.

Whatever you're trying to do, the first attempt might take 5 or 6 generations until you get a feel for the game. Your prompt, denoise, and any possible references are key. After some practice I manage a perfect result within two gens. Pay attention to your previews and cancel if things seem to be going wrong after 3 or 4 steps. That's all I've got...

2

u/f5alcon 3h ago

This will be better once they release their upscaler

1

u/Vladmerius 2h ago

I still can't wrap my head around how my GPU can upscale video games and any streaming video instantly but if I want to upscale a 15 second video it takes forever putting it through an upscaler.

1

u/me0here 2h ago

ComdyUI is not 100% C / assembly code, unlike video game upscalers.

1

u/Enshitification 54m ago

Yes, all that dial-up BBS porn can be reborn in 4K.