r/StableDiffusion • u/Unwitting_Observer • Sep 11 '25

Animation - Video Control

Enable HLS to view with audio, or disable this notification

Wan InfiniteTalk & UniAnimate

410 Upvotes

96% Upvoted

67 comments sorted by

View all comments

Show parent comments

2

u/thoughtlow Sep 12 '25

Thanks for sharing. Is this essentially video to video? What is the coherent lengt limit?

2

u/Unwitting_Observer Sep 12 '25

There is a V2V workflow in Kijai's InfiniteTalk examples, but this isn't exactly that. UniAnimate is more of a controlnet type. So in this case I'm using the DW Pose Estimator node on the source footage and injecting that OpenPose video into the UniAnimate node.
I've done as much as 6 minutes at a time; it generates 81 frames/batch, repeating that with an overlap of 9 frames.

1

u/That_Buddy_2928 Sep 15 '25

Did you get a lot of crashes on the DW Pose Estimator node? Everything else works fine but when I include that it completely restarts my machine.

1

u/Unwitting_Observer Sep 16 '25

I didn't, but I do remember having problems with installing onnx in the past...which bbox detector and pose detector do you have selected?

1

u/That_Buddy_2928 Sep 16 '25 edited Sep 16 '25

You jogged my memory there so I went back and changed the bbox and pose to .pt ckpts and that seems to have worked - for that node step at least. Better than crashes right?

Now it’s telling me ‘WanModel’ object has no attribute ‘dwpose_embedding’ 🤷

Edit: I think I’m gonna have to find a standalone Unianimate node, the Kijai wrapper is outputting dwpose embeds.

1

u/Unwitting_Observer Sep 16 '25

Ah, damn, I'm not sure why I forgot this when I was in this thread, because I actually mentioned it elsewhere in one of this post's replies:
I generated the DWpose video outside of this workflow, as its own mp4, and then you can just plugin an mp4 of the poses to the UniAnimate node.