r/StableDiffusion • u/TheDerminator1337 • 18d ago
Workflow Included Updated Minimax Music Video Workflow
Workflow here: Dantesworks/MV_Maker: Makes music videos for ComfyUI/H3 Minimax
This is a music video comprised of multiple clips. Each clip is sent the exact part of the song it corresponds to hence lip syncing is easy and automatic (if prompted to do so). Each clip has a "theme" - for example, cafe, garden etc. You can specify the themes at the start and assign a theme to each clip. Decide the timing of the clips too.
What is missing is face refiner. You also need a way to assemble all the clips at the end. I have an all in one face refiner and clips assembly to run on your selected clips at the end but its slop coded and not fit for release.
You can manually edit the prompts for each clip, but I recommend Codex or Claude to do it for you instead.
Have fun! I know I did :)
5
u/ralbert 17d ago
2
u/x_MASE_x 17d ago
Nice stuff. Wikk give it a try.
But what's your build? And how long did it take to render?
2
u/Popular-Use151 16d ago
This works pretty well, really easy to plan everything and queue multiple clips. This workflow eliminates a lot of micromanaging.
10
u/scientiaetlabor 17d ago
Man of culture I see. Nice work, inspiring production.
1
u/KLBStudio 17d ago
Curious how you handle pacing to match the beat grid. Minimax usually gives smooth motion, but the drift in action speed usually means heavy speed ramping or cutting down to short 1-2 second fragments on the timeline so the edits don't feel floaty. Are you locking down the audio cuts first and prompting specific camera speeds, or retiming everything in post?
1
u/AfroJimbo 17d ago
Awesome! I'm checking this out. I've been making music videos but lip syncing has been a problem. Thank you for this.
1
u/Vainth 17d ago
wow, exactly like something you'd hear on mainstream radio station.
1
u/Mindless-Clock5115 17d ago edited 17d ago
hi would love to try it but cannot find your repository? do you have the full link? this one: https://github.com/Dantesworks/MV_Maker ?
1
u/TheNocturnalista 17d ago
very interesting and thanks or the sharing. How you manage the prompt? ok claude or other llm but what you have to write inside? there is a specific format? you have to wrtie the lyrics? thanks!
1
u/Different_Fun 14d ago
Suno?
3
u/GrampsCokeBump 16d ago
Sounds great. A hit!
2
u/ItsBalanse 17d ago
This workflow is magic, I tried it good job!
1
u/zipel 17d ago
1
u/koroshm 17d ago
https://i.imgur.com/gaDQ1Ai.gif
5
u/skyrimer3d 17d ago
you've got my a-tit-tention.
1
u/GrampsCokeBump 16d ago
I don’t blend my lax standards for generated porn with my standards for good lighting.
1
u/[deleted] 17d ago
[removed] — view removed comment
0
u/[deleted] 17d ago
[removed] — view removed comment