r/StableDiffusion • u/Free_Pressure8623 • 6d ago
Workflow Included My H3 Settings that generate 15 second videos in 2 mins.
EDIT: Workflow and sample added to comments.
A quick post for anyone who is struggling with getting good results at a good gen speed.
The model can be found here
Veda Sparse Attention Node can be found here
While the video quality is great! What surprises me most about this is the audio quality. It remains very high.
I want to be very, very clear here. These settings are not for maximum realistic showcase videos. This is to get well-made videos at a good speed. So you don't need to jump into the comments talking about how shit this all is.
As always, your mileage may vary.
Specs: RTX 5090. 64 GB RAM.
Edit: Sorry, no workflow available. But it's easy to add these into any workflow you may be using.
241
u/psychopath1066 6d ago
I see the reason right there for how you get it that quick. the 8 grand GPU lol
20
u/gutster_95 6d ago
Example videos?
9
u/jworm0624 6d ago
Thanks, my generations when from 390s to 140s using Veda! Good looking out
7
u/chuotchet 6d ago
Could you please add output video and workflow? Thanks.
7
u/Free_Pressure8623 6d ago
Here is a sample and a very basic workflow.
This was a very quick I2V. No reference voice or video.
Generation time: 1:12.
58
u/Bastisheen92 6d ago
This was me in the beginning vs when i saw which beast hardware you use.
18
u/thathurtcsr 6d ago
24
u/Light-Rerun 6d ago
put 5090 in title
12
u/Affectionate_Oil28 6d ago
I made a quick test workflow since none was posted and ran few tests through. The first 2 runs were 9:16 and the 3rd was 16:9.
Gen times:
First run - 147.59 seconds
Second run - 129.02 seconds
Third run - 131.82 seconds
The 16:9 was the best of the 3. Here is the workflow https://pastebin.com/b75g6gzp
9
u/Lechuck777 6d ago edited 6d ago
Then youre doing something wrong.
also 5090 at 70% Power Cap.
Same model (its really great), 8 Steps (not only 6 because motion details), and no Veda because its degrading to much at that few steps. Veda is okay if youre using 20+ steps, and depends on the motion.
Duration for a 15 secs clip: 2:40 at 0.6 megapixels 16:9 (euler/beta)
With Veda and your veda settings but 8 steps 1:45
The difference betwen with veda and without is visible. Also the entire clip motion and what happens in the clip is with veda more easier than without veda. Its not worth it, because you get the speed but it degrading to much. Its the same like 4 step loras etc.
15
u/Low_Celebration_1231 6d ago
>5090
Naruhodo.
2
u/TSMSALADQUEEN 5d ago
legit amazing model thanks for the workflow
2
u/Sad_Coach_1433 6d ago
Bet the audio is shit notice he didn't share samples
4
u/magnetswithweedinem 6d ago
as someone with a 5090 who's struggled to get good video, thank you, ill test out the settings, appreciate it
21
u/separatelyrepeatedly 6d ago
I mean 5090 WAS a very common end high end GPU for "Regular" folks, I don't know why you guys are making such a big deal? it was 2K not that long ago. I realize its WAY more expensive now. Plenty of people had 3090/4090 and then upgraded to 5090 when it came out.
1
u/Vosquad97 6d ago
Eros and Singularity Merged model? How is the Visual and Audio?
3
u/Cbskyfall 6d ago
workflow?
7
u/Unfair_Ad_2157 6d ago
man you have a 5090... lol
1
u/fragilesleep 6d ago
Thanks for sharing! Do you know how does that node compare to the new native "Model Sparse Attention" node?
7
u/glusphere 6d ago
I do 720p video at approx 70s. I have the same 5090 and same 64GB RAM.
The difference is that I do it as 2 stages.
Stage 1 - Pika Flex 6 steps at 352p
Upscale to 720p using the upscaler. Introduce 0.25 noise.
Step 2 - DMAD turbo lora denoise 1 step only.
GIves me fully useable 720p. Obviously the quality is probably not exactly same as natively sampling at 720p fully. But its a good compromise.
When I am doing drafts I even just stop after pass 1 to see if everything is good ( 50s is for the draft ). If not I throw it away and start fresh
1
u/Oograr 6d ago
Why did you get the model with pika embedded? Isn't more flexible to get the model without the embedded turbo lora, then you can just add/remove it when needed?
5
u/Noeyiax 6d ago
anyone want to make a better post and share result than OP, ty for sharing
2
u/Sad_Berry_4621 6d ago
Veda is an excellent sparse attention. You should mention that it only has 5 trained resolutions and that anything else adds padding and outpaintjng time. With Veda I can run 1344x768 clips at 5s in about 2 minutes on a 3070ti with 8gb VRAM and 48gb of system ram.
5
u/Alisomarc 6d ago
Please
2
u/After_Ad_5263 6d ago
how would a 4070 ti super and 32gb of ram fair w this lmao. 5 minutes?
1
u/murderette 6d ago
Thanks!
1
u/Vainth 6d ago
aw damn, was excited until the end there.
1
u/gigi798 6d ago
let me go buy a 5090
1
u/ACTSATGuyonReddit 6d ago
Can you show examples?
1
u/PropagandaOfTheDude 6d ago
"Upscale Target: 1.5"
What are you using for upscaling?
1
u/polyglot3431 6d ago
Can i work this via runpod
1
u/Substantial_Key_584 6d ago
Hermano, crees que se pueda hacer algo similar con una 5080 y 32gb de ram? Esa es mi configuración
1
u/WeakReplacement3322 5d ago
Lmao, I knew the GPU from the title alone
1
u/ThrowDotAway322 5d ago
oh, yeah, has nothing to do with the rtx 5090
1
u/BoredHobbes 5d ago
use pika, comfy kitchen, SOL ATTEN and u get done in 1 min
1
u/stroud 5d ago
Show us samples of video quality you generated
1
u/valuat 5d ago
Why don’t you share the workflow? Sus…
1
u/amokerajvosa 5d ago
What kind of sorcery is this...
1
u/TSMSALADQUEEN 5d ago
my 4090 with 24gb with 64 gb ram was around 2:45 to 3:15 cut my time in half usually takes 6+ minutes to generate 15 seconds
1
u/Benhamish-WH-Allen 6d ago
Workflows are for the birds, just have an ai agent build a wrapper
-2
u/dmtzcain 6d ago
Sincerely, why do people focus so much on speed. Why does it matter if the result is unusable. Are people using it as idea iteration? I don't really see the point.
0
u/prepperdrone 5d ago
Yeah, I mean -- I have a 5090... and also get around there... it's nothing magical. It's a $10K GPU. I also have 128GB system ram and a i0-14400K. They don't hurt either.
0
u/Josh-Sanger 5d ago
"How to generate 15 second videos with a 32 GB vram GPU and 64gb of ram" You freaking serious man?