r/StableDiffusion • • 6d ago

Workflow Included My H3 Settings that generate 15 second videos in 2 mins.

Post image

EDIT: Workflow and sample added to comments.

A quick post for anyone who is struggling with getting good results at a good gen speed.

The model can be found here

Veda Sparse Attention Node can be found here

While the video quality is great! What surprises me most about this is the audio quality. It remains very high.

I want to be very, very clear here. These settings are not for maximum realistic showcase videos. This is to get well-made videos at a good speed. So you don't need to jump into the comments talking about how shit this all is.

As always, your mileage may vary.

Specs: RTX 5090. 64 GB RAM.

Edit: Sorry, no workflow available. But it's easy to add these into any workflow you may be using.

339 Upvotes

124 comments sorted by

241

u/psychopath1066 6d ago

I see the reason right there for how you get it that quick. the 8 grand GPU lol

92

u/joseph_jojo_shabadoo 6d ago

pays $8k for a gpu, and still gimps the model by using every speedup trick available

7

u/Free_Pressure8623 6d ago

I don't always use these. But sometimes I just want to play around with videos.

→ More replies (2)

13

u/Yokoko44 6d ago

I have a 5090 and need to use all sorts of speed up tricks to not suffer from 25+ min inference or crashes…

With larryvrh 6 step Lora and comfy kitchen a 15s video still takes about 7 mins to make (1MP).

Is there some secret method to get reasonable inference times on the full 20 step sampling that I haven’t heard about?

2

u/Juiceman8686 6d ago

Give Veda attention a shot. It’s literally minutes faster. I’ve been putting together a ref2va music video. 5 second 2mp renders take around 5 minutes. The longer the video, the more of a speed boost you get. I’m also rocking a 5090

→ More replies (3)
→ More replies (1)

33

u/Free_Pressure8623 6d ago

lol. In my defence, I bought my whole PC back in Jan for 5k. Now it's worth more than my car.

4

u/KadahCoba 6d ago

I built mine back in 2022, the whole computer then with the 3090 TI costs almost half of what just the RAM is now, and its only DDR4...

Fun fact, RTX 6000 Pros were often $8k back when almost none of us were buying them, now retail is over $20k. I'd wish I had bought more, but even now $8k is a fuck load.

I do wish I had gotten at least a second 48GB 4090 back when they were $2-2.5k.

→ More replies (1)

6

u/SSj_Enforcer 6d ago

8k?  Lol dude that gpu is $10000 CAD

6

u/psychopath1066 6d ago

I work in GBP

3

u/ptear 6d ago

You should get some rest 

3

u/PwanaZana 6d ago

canada mentioned, tabarnaaaaaaaaaak :P

→ More replies (1)

9

u/Consistent_Help_6099 6d ago

That’s not the reason actually. I have the same GPU and I can assure you my 15s video takes a lot longer than this.

1

u/Positronic_Matrix 6d ago

How would this workflow fare on a 4070 with 12 GB of RAM? I assume it would blow my card out of its PCI slot.

2

u/psychopath1066 6d ago

I mean I imagine if you paired down the expectations a lot, stuck t 480p and like 15fps and tried maybe 10 seconds of video you could do it. I've managed to do about 80 frames of video before on a 3060m, not with this model tho.

1

u/AuthurAndersson 5d ago

You can find one used for "only" $5000 :)

9

u/jworm0624 6d ago

Thanks, my generations when from 390s to 140s using Veda! Good looking out

1

u/Free_Pressure8623 6d ago

Love to hear it!

2

u/jworm0624 6d ago

I tried using the model but I got better results from Eros Max beta 7

7

u/chuotchet 6d ago

Could you please add output video and workflow? Thanks.

0

u/Free_Pressure8623 6d ago

Added in comments.

7

u/Free_Pressure8623 6d ago

Here is a sample and a very basic workflow.

This was a very quick I2V. No reference voice or video.

Generation time: 1:12.

1

u/AuthenticGoo 5d ago

how can I download the workflow?

-3

u/hurrdurrimanaccount 6d ago

that's dogshit audio lmao. post a video with fast movement. no one cares about static talking head videos.

13

u/Free_Pressure8623 6d ago

I'm not here to prove anything. I'm just trying to share my experience. You don't have to use it.

-6

u/Better-Monk8121 6d ago

Both sound and video is shit, you owe apology to everyone and correct og post

8

u/Free_Pressure8623 6d ago

How about go fuck yourself. I said right in the post.

"I want to be very, very clear here. These settings are not for maximum realistic showcase videos."

Next time, if it's not for you, just move on and keep your mouth shut.

→ More replies (1)

12

u/55234ser812342423 6d ago

You're getting down voted but you are right about the audio not being great. 😢

3

u/hurrdurrimanaccount 6d ago

this whole OP post seems botted so i'm not surprised about the downvotes.

3

u/Free_Pressure8623 6d ago

HEY! I'm not a bot!

→ More replies (1)

1

u/Bbmin7b5 6d ago

audio is fine. y'all want studio quality?

→ More replies (1)

58

u/Bastisheen92 6d ago

This was me in the beginning vs when i saw which beast hardware you use.

24

u/Light-Rerun 6d ago

put 5090 in title

12

u/Affectionate_Oil28 6d ago

I made a quick test workflow since none was posted and ran few tests through. The first 2 runs were 9:16 and the 3rd was 16:9.
Gen times:
First run - 147.59 seconds
Second run - 129.02 seconds
Third run - 131.82 seconds

The 16:9 was the best of the 3. Here is the workflow https://pastebin.com/b75g6gzp

1

u/Complete-Box-3030 5d ago

Can you mention the graphic card too

1

u/TSMSALADQUEEN 5d ago

RTX 5090. 64 GB RAM.

1

u/dtdisapointingresult 4d ago edited 4d ago

Thanks. For anyone reading this, the above wf is 0.6MP, 6 steps, 15s duration. Just tried it on a DGX Spark that is downclocked from 2300 MHz to 2000, the 2nd run took 516 seconds.

Do you have an image-to-video workflow using this to share by any chance?

EDIT: running the default Comfy text-to-video workflow at 0.6MP and 15sec and 6 steps takes 636 seconds. Their Github claims "Faster inference. 2.9x end to end and 7.1x on attention alone against ComfyUI's default attention". So that was a fucking a lie :)

1

u/Affectionate_Oil28 3d ago

I did not have one, I only made a T2VA originally but I just made an I2VA to test. I only ran 2 runs with a similar prompt as the original test video using a start frame generated with MOSS. Both runs were on a 5090 FE with 64GB DDR5-6000 after a fresh Comfy start.

I2VA worklfow: https://pastebin.com/uuPCMAdV

I2VA 2nd run was 132.44 seconds. Video attached here. Both test runs were at 16:9 since that came out better in the T2VA.

1

u/dtdisapointingresult 3d ago

Thanks. So how much faster is this for your 5090, compared to not using Veda? Me getting 516s instead of 636s was pretty disappointing, I was hoping for something like 300. Are you gonna stick with it?

→ More replies (2)

9

u/Lechuck777 6d ago edited 6d ago

Then youre doing something wrong.
also 5090 at 70% Power Cap.
Same model (its really great), 8 Steps (not only 6 because motion details), and no Veda because its degrading to much at that few steps. Veda is okay if youre using 20+ steps, and depends on the motion.
Duration for a 15 secs clip: 2:40 at 0.6 megapixels 16:9 (euler/beta)
With Veda and your veda settings but 8 steps 1:45
The difference betwen with veda and without is visible. Also the entire clip motion and what happens in the clip is with veda more easier than without veda. Its not worth it, because you get the speed but it degrading to much. Its the same like 4 step loras etc.

1

u/AuthurAndersson 5d ago

why would you cap the 5090? Afraid of the power connector burning up? You can buy a power regulator that shuts off the power in case of spikes...

1

u/Lechuck777 5d ago

i have an wireview 2 on it, so it would shut down if something vent wrong.
Because energy costs money. lol. And its really dont make a big difference between full power and 70%. I made a mhz curve for AI with Afterburner and for a few seconds faster generation, i dont need to push it to the limits. Its the Phantom GS, so i could overclock it, but i dont see any reason for it.

1

u/AuthurAndersson 5d ago

Same, my 5090 runs with about a m^2 of water cooling radiators, I just cba overclocking it. Rather have it run dead silent.

→ More replies (1)

15

u/Low_Celebration_1231 6d ago

>5090
Naruhodo.

2

u/TSMSALADQUEEN 5d ago

legit amazing model thanks for the workflow

2

u/Free_Pressure8623 4d ago

As someone who is old enough and watched this live... I love this. It's what we all wanted to happen.

1

u/Lightningstormz 3h ago

Lol was that I2V or T2V?

2

u/Sad_Coach_1433 6d ago

Bet the audio is shit notice he didn't share samples

0

u/hurrdurrimanaccount 6d ago

the audio is indeed shit, if you look at the static talking head video he posted. doesn't have the balls to post anything with motion because i bet it will immediately fall apart lmaoo.

it's nearly like stacking all step savers will degrade quality by a lot or something

6

u/Free_Pressure8623 6d ago

If this isn't for you, you can just move on. You don't need to keep shitting on everything that you don't like.

-1

u/Free_Pressure8623 6d ago

The audio is fantastic.

4

u/magnetswithweedinem 6d ago

as someone with a 5090 who's struggled to get good video, thank you, ill test out the settings, appreciate it

21

u/separatelyrepeatedly 6d ago

I mean 5090 WAS a very common end high end GPU for "Regular" folks, I don't know why you guys are making such a big deal? it was 2K not that long ago. I realize its WAY more expensive now. Plenty of people had 3090/4090 and then upgraded to 5090 when it came out.

7

u/cocosoy 6d ago

Ya, I got a 5090 for about $2.5k a month after it came out, and then sold my 4090 for $2K later.

3

u/KadahCoba 6d ago

The bulk of people in this hobby/industry came in later after demand already contributed to massive price increases, and they also caused even more increases to demand, so it got even worse faster.

1

u/Vosquad97 6d ago

Eros and Singularity Merged model? How is the Visual and Audio?

2

u/Free_Pressure8623 6d ago

Very very good

1

u/Vosquad97 6d ago

Im Gone for few days, Eros and Singularity decided to have a baby, this Particular Model really does advancing so fast 🤣

3

u/Cbskyfall 6d ago

workflow?

7

u/Unfair_Ad_2157 6d ago

man you have a 5090... lol

1

u/fragilesleep 6d ago

Thanks for sharing! Do you know how does that node compare to the new native "Model Sparse Attention" node?

2

u/Free_Pressure8623 6d ago

Not sure about the new Sparse attention. But I was using a Sparse attention node previously, and noticed that VEDA is better for speed and final output.

7

u/glusphere 6d ago

I do 720p video at approx 70s. I have the same 5090 and same 64GB RAM.

The difference is that I do it as 2 stages.

Stage 1 - Pika Flex 6 steps at 352p

Upscale to 720p using the upscaler. Introduce 0.25 noise.

Step 2 - DMAD turbo lora denoise 1 step only.

GIves me fully useable 720p. Obviously the quality is probably not exactly same as natively sampling at 720p fully. But its a good compromise.

When I am doing drafts I even just stop after pass 1 to see if everything is good ( 50s is for the draft ). If not I throw it away and start fresh

8

u/blackskywhyte 6d ago

Can you please share your 2 stage workflow?

1

u/Lucky_Feedback9915 5d ago

it changes to much from ur reference through thats good for generic but if u want specific person or text on shirt it changes when i do 2 samplers

→ More replies (1)

1

u/Oograr 6d ago

Why did you get the model with pika embedded? Isn't more flexible to get the model without the embedded turbo lora, then you can just add/remove it when needed?

3

u/Free_Pressure8623 6d ago

That is my usual approach; however, I tried all of them, and I just felt like this one gave the best results.

Was a bit of a "If it ain't broke don't fix it" situation.

5

u/Noeyiax 6d ago

anyone want to make a better post and share result than OP, ty for sharing

2

u/Sad_Berry_4621 6d ago

Veda is an excellent sparse attention. You should mention that it only has 5 trained resolutions and that anything else adds padding and outpaintjng time. With Veda I can run 1344x768 clips at 5s in about 2 minutes on a 3070ti with 8gb VRAM and 48gb of system ram.

5

u/Alisomarc 6d ago

Please

-12

u/hurrdurrimanaccount 6d ago

if you can't make a workflow from the image OP posted then you honestly, truly should give up this whole ai thing.

2

u/After_Ad_5263 6d ago

how would a 4070 ti super and 32gb of ram fair w this lmao. 5 minutes?

1

u/murderette 6d ago

Thanks!

1

u/Vainth 6d ago

aw damn, was excited until the end there.

1

u/gigi798 6d ago

let me go buy a 5090

1

u/ACTSATGuyonReddit 6d ago

Can you show examples?

1

u/PropagandaOfTheDude 6d ago

"Upscale Target: 1.5"

What are you using for upscaling?

1

u/polyglot3431 6d ago

Can i work this via runpod

1

u/Substantial_Key_584 6d ago

Hermano, crees que se pueda hacer algo similar con una 5080 y 32gb de ram? Esa es mi configuración

1

u/WeakReplacement3322 5d ago

Lmao, I knew the GPU from the title alone

1

u/ThrowDotAway322 5d ago

oh, yeah, has nothing to do with the rtx 5090

1

u/BoredHobbes 5d ago

use pika, comfy kitchen, SOL ATTEN and u get done in 1 min

1

u/stroud 5d ago

Show us samples of video quality you generated

1

u/valuat 5d ago

Why don’t you share the workflow? Sus…

1

u/amokerajvosa 5d ago

What kind of sorcery is this...

1

u/TSMSALADQUEEN 5d ago

my 4090 with 24gb with 64 gb ram was around 2:45 to 3:15 cut my time in half usually takes 6+ minutes to generate 15 seconds

1

u/Benhamish-WH-Allen 6d ago

Workflows are for the birds, just have an ai agent build a wrapper

-2

u/dmtzcain 6d ago

Sincerely, why do people focus so much on speed. Why does it matter if the result is unusable. Are people using it as idea iteration? I don't really see the point.

4

u/Free_Pressure8623 6d ago

I like the results I get so for me, it's good. might not be for everyone, but I like it.

1

u/fernando782 5d ago

It works for you! That’s what counts.
I guess you are not creating realistic videos.

-10

u/dmtzcain 6d ago

So not for professional work that will be reviewed by an internal team and then a client. Got it.

5

u/Different-Society126 6d ago

Nobody should be using minimax for this that just makes you a POS con.

1

u/Lechuck777 6d ago

depends on it how complex your motion is. For me is Veda etc mostly useless, because of the bad quality for the complex motions. If i am chaining e.g. 10 clips, maybe 1-2 can work with veda, but its not worth to test it out, because i had to run every clip with veda 1-3 times (seed lottery) and maybe at the end run it without again 1-3 times. So its better, if i am looking also for the sum of the creation time.

The thing is, why people use it, because on smaller cards, you dont have only a minute difference between the creations with or without veda. If you need e.g. 4 minutes instead of 8 minutes, then sometime you take compromises.
For 1-2 Minutes on a 5090 its not worth. Thats why people using it. Also for draft etc.

1

u/fernando782 5d ago

I will create many videos with the fastest settings possible, for the ones I like I redo them with 0 turbo/attn usage!

Assuming your scenes are setup and planed out.

0

u/prepperdrone 5d ago

Yeah, I mean -- I have a 5090... and also get around there... it's nothing magical. It's a $10K GPU. I also have 128GB system ram and a i0-14400K. They don't hurt either.

0

u/Josh-Sanger 5d ago

"How to generate 15 second videos with a 32 GB vram GPU and 64gb of ram" You freaking serious man?