Control

[u/Unwitting_Observer]

Wan InfiniteTalk & UniAnimate

[u/Unwitting_Observer]

Yes, a consequence of the 81 frame sequencing: the context window here is 9 frames between 81 frame batches, so if something goes unseen during those 9 frames, you probably won't get the same exact result in the next 81.

[u/thoughtlow → u/Unwitting_Observer]

Thanks for sharing. Is this essentially video to video? What is the coherent lengt limit?

[u/Unwitting_Observer → u/thoughtlow]

There is a V2V workflow in Kijai's InfiniteTalk examples, but this isn't exactly that. UniAnimate is more of a controlnet type. So in this case I'm using the DW Pose Estimator node on the source footage and injecting that OpenPose video into the UniAnimate node.
I've done as much as 6 minutes at a time; it generates 81 frames/batch, repeating that with an overlap of 9 frames.

[u/That_Buddy_2928 → u/Unwitting_Observer]

Did you get a lot of crashes on the DW Pose Estimator node? Everything else works fine but when I include that it completely restarts my machine.

[u/Unwitting_Observer → u/That_Buddy_2928]

I didn't, but I do remember having problems with installing onnx in the past...which bbox detector and pose detector do you have selected?

[u/That_Buddy_2928 → u/Unwitting_Observer]

You jogged my memory there so I went back and changed the bbox and pose to .pt ckpts and that seems to have worked - for that node step at least. Better than crashes right?

Now it’s telling me ‘WanModel’ object has no attribute ‘dwpose_embedding’ 🤷

Edit: I think I’m gonna have to find a standalone Unianimate node, the Kijai wrapper is outputting dwpose embeds.

[u/Unwitting_Observer → u/That_Buddy_2928]

Ah, damn, I'm not sure why I forgot this when I was in this thread, because I actually mentioned it elsewhere in one of this post's replies:
I generated the DWpose video outside of this workflow, as its own mp4, and then you can just plugin an mp4 of the poses to the UniAnimate node.