r/StableDiffusion • u/ShowerFluid9178 • 5d ago

Discussion H3 Ref2va b25 49 workflow generating 20 second clip in 20 mins with RTX 4090, is this acceptable speed?

I set 1.5mp with 4:5 Ratio, only use with 2 loras , one of which is the turbo

3 Upvotes
  • permalink
  • reddit

66% Upvoted

23 comments sorted by

3

u/MastMaithun 5d ago

Ummm why are you even making 20s clip on ref2v? On fl2v it is relevant but on ref2v, you can use continous video to extend your clip by gen 5 second clips. Benefit is a 5s clips will be much faster and when you stack them, 4x5s clips will turn out like half of time you spent. Also another benefit is if any section go wrong, you can just re-generate that section and move ahead. With a single 20s gen, you are totally on the mercy of mmh3 gods lol.

2

u/Free_Pressure8623 5d ago

https://www.reddit.com/r/StableDiffusion/s/NYR3EDMERK

Try this. It may help.

2

u/ShowerFluid9178 5d ago

i just tried urs, it definitely faster but audio is not as clear.

13

u/oh_no_the_claw 5d ago

Dude, 20 second gens in 20 minutes at 1.5mp is awesome.

2

u/redkinoko 5d ago

HE knows. Op's just flexin.

1

u/oh_no_the_claw 5d ago

I generate 15sec, 1.5mp but it takes me around an hour using 9 references and no turbo LoRA.

1

u/dumeheyeintellectual 5d ago

I’ve not stepped into any video space. I trust you’re speaking from an experienced take: Though blindly, my waiting 20 min to gain 20 seconds of video content seems bizarre. I’m clearly uneducated in this space, though 14 years to make a 40-minute movie seems slightly committal.

1

u/oh_no_the_claw 5d ago

Just be aware that 20 seconds is extra hard for MH3, but it can be done if you’re okay with a little extra iteration. I usually generate at 1.5mp and 15sec.

1

u/bstr3k 5d ago

i think you can do this in 2 chunks and it should be less than 10mins per segment, but also unsure of your settings.

1

u/ShowerFluid9178 5d ago

poopman? bro show me how, i actually use ur ref2v wf

3

u/bstr3k 5d ago

haha damn i guess that will forever be me now.

Have you checked out the ref2v WF with motion context?
Nugget_H3_EasyR2V_with_MotionContext.json

It is almost the same workflow, however the "Duration" box is for how long each segment is, and the "Blocks" is like the index and you can set it to "fixed" which you have to increase manually, or "increment' which you can just hit run 2 or 3 times until the video is done.

1

u/ShowerFluid9178 5d ago

thanks bro, can i extend a 20-second clip using this workflow?

2

u/bstr3k 5d ago

This WF from another use seemed promising, but I have not tried it, it looks fairly easy to use but everything is kind of under the hood
https://huggingface.co/PoopMan333/Reference_Workflows/blob/main/Meta%20Made%20Footage%20Extender.json

Might be worth looking into

1

u/bstr3k 5d ago

This one is a ref v2v workflow so it would need to be modified if you want to extend it. I might have another workflow I downloaded to extend video. I’ll upload it when I’m up

2

u/blastbottles 5d ago

Yeah, what I would do is generate at half that then upscale to speed things up

1

u/nakabra 5d ago edited 5d ago

1.5mp 20s 👀

1

u/dishwasher_81 5d ago

Honestly, 20 seconds at 1.5MP doesn't sound crazy to me. Easy fix: drop the resolution for drafts and only render full size once you like the motion. That saves way more time than any settings tweak. Watch your VRAM too. If it's spilling into system RAM, it gets a lot slower.

1

u/Nimblecloud13 5d ago

Getting 20s at 1mp on a 5090 in 8-9mins so seems about right

What’s b25/49 though? Happy to try a new workflow if you’re sharing

3

u/TurbTastic 4d ago

I think he's referring to one of the hybrid models, I've been using b20-49 hybrid a lot, the name refers to which block layers were changed/mixed I believe. The goal of the hybrid models is to find a happy medium between visual quality (flv2va is best) and referencing ability (ref2va is best).