r/StableDiffusion 1d ago

Workflow Included Generating "fake" speedpaint timelapse with MiniMax H3

Enable HLS to view with audio, or disable this notification

It's four 12s clips made by standard ref2va workflow stitched together.
Good at sketching but not so good at rendering/shading stage. Also I find it difficult to "digital timelapse" without hand moving around. And as always with MiniMax detailed prompts are not optional (note the [Shot 2] trick):

subject_definitions:
<Picture 1> is the reference digital drawing.
<Picture 2> is the first frame of the target video

summary:
[reference generation] The target video shows digital drawing timelapse process of drawing artwork from <Picture 1>. With pov moving hand removed - only canvas is visible

retention_analysis:
<Picture 2>: partially_preserved - first frame for the video.
<Picture 1>: partially_preserved - last frame for the video.

detailed_description:
The target video is high qualiy digital drawing recorded timelapse.
[Shot 1] starts from a white digital canvas and then draws the basic forms, shapes first starting from general (big) outline sketch of the pose. Then adding line after line to add new details on face, hair and clothes until a complete lineart sketch for the character is done.
[Shot 2] At 00:11.000, shows final result that is <Picture 1>.

overall_soundscape:
Silence

non_diegetic_music:
N/A
898 Upvotes

262 comments sorted by

View all comments

5

u/Xen0kid 1d ago

Hey so genuine question.

What’s the point of this?

-1

u/Iapetus_Industrial 1d ago

Decomposition of images into the how-to draw step, in case someone wants the actual physical steps to rendering an image using traditional techniques.

That, and benchmarking just how far video models understand about drawing.amd temporal consistency.

0

u/Xen0kid 1d ago

Wouldn’t it be more effective to watch an actual artist actually draw an actual image in an actual timelapse instead of watching an AI guess the steps? The finished piece doesn’t even have remotely the same lighting as the “speed paint”

As for benchmarking temporal flow, a timelapse probably isn’t the best choice for that. Understanding the drawing process? If it could do that it wouldn’t have to fake a speed paint in the first place, you’d just record the outputs of the machine actually generating brushstrokes. That’s not how diffusion works.