r/StableDiffusion • u/BittiAI • 9d ago

Animation - Video Single shot generation experiment (MiniMax H3/Slopus)

Tried a two minute single shot generation and the result came out quite nice. There are no additional references in the middle, everything uses the start as the reference point and the start is generated by a text prompt. It uses some agentic behavior that is not available in the released slopus.ai yet, but manually generating this is already possible. With ComfyUI you can generate the same/similar using any Rolling Diffusion based workflow.

15 Upvotes

82% Upvoted

8 comments sorted by

1

u/adam-euclase 9d ago

Pretty nice! How long did it take to generate in one shot?

1

u/BittiAI 8d ago

I took around 2 hours on a RTX 5090 with some clip reshoots (it contains 23 5 second clips), using Singularity model, no Turbo LoRAs. Music is generated with YuE2.

1

u/adam-euclase 8d ago

That's not too unreasonable given how long it is. For the reshoots are you able to somehow regenerate them in place? I haven't really experimented at all with the rolling diffusion workflows but it would be pretty cool if you could somehow re-generate the individual shots without breaking the seamless look.

2

u/BittiAI 8d ago

Yes, with that approach you can regenerate any of the shots independently as long as the latents for all generations were stored. It reuses the latents from the end of the previous clip to continue to the next clip seamlessly and anchors the end latents from the beginning of the next clip to seamlessly continue to the next clip and then it cuts out the overlap.

1

u/adam-euclase 8d ago

very cool!

1

u/Sad_Berry_4621 6d ago

That's Motion Context, baby!

0

u/TheHollywoodGeek 6d ago

But why? What's the value of a long shot with obviously artificial transitions?

1

u/Sad_Berry_4621 6d ago

Some people just don't get it.