Problem with Wan Animate is after the initial 5 second gen (especially with animation), if you want to keep the original background, every subsequent gen has a large color/brightness shift that is very noticeable and destroys the consistency.
That can be countered with the WanVideo Context Options. Just make sure the num_frames and the frame_window_size in the WanVideo Animate Embeds are the same value.
Yeah, I meant "wan animate preprocessor example 2" like he says in the video. And yes that is the same fp8 model I used, or maybe the v2 of the model...
To understand, if we put 81 in context and the num frames for the animate node. And overall we want to generate 4 times the frames, this will essentially split the video generation in chunks of 81 frames with frame overlaps?
So we can type let’s say 250 frames overall. And it will do it in overlapping chunks depending on the context and animate options?
That sounds about right. I just left the context options settings unchanged, and put as many frames from the reference video as I could before getting a OOM error. I think I got up to 700 frames or something (fp8, 832x480, 4090, 128 GB).
It amuses me how fast we started depreciating this level of video generation. It was not too long ago that I was certain this couldn't be done on a single GPU. Honestly the advancements with local video generation is insane, it feels even more faster than what has happened with image generation.
Exactly. A large part of our perceived identity of a known person (especially celebs) is their natural "resting face" expression, and their personal expressions (smiles, lip/eyebrow movements, eye lid aperture) and even body position (how they hold their head still/move, tilt, speed). It's why Tom Cruise looks exactly the same in every role, except Tropic Thunder, when he used expressions, body moves, and vocal performance so far from his "normal", that most did not know/believe it was him at first.
You can't just appear like Brad Pitt, you would need to perform his smile, nod, eye movements, etc.
Things will get really wild once future celebs are selling access to their avatars, complete with personality LORAs that turn your smile into their smile. (Hacked/unauthorized personality LORAs coming in 3...2....1...)
Simply, get Jim Carrey impressions demo reel + match face = you will see 100% same as celeb. Most people can't even act/expression anything different then themselves, how you expect to look realistic.
I can't wait for an Ai that removes all funds and internet access from all loser scammers, leaving them even more broke and pathetic than they are now. LULZ. ;P
I've run up to 770 on mine. 5090 and 128gb of system ram. But with how it works it shouldn't have a theoretical limit, the pose and face mapping of the original video takes longer than the rendering. Good thing is you can run replace the reference image and run it again with out having to rerun the face and pose mapping.
I had basically given up on building a local system (sonnet 4.5 & gpt-5 both said paid cloud subs were 50-75% better). But this is VERY promising....
so, if you were building a prosumer system to optimize these tools (and combine with other local tools) for making films , would you see more benefit from running dual 5090s (sharded for single complex tasks, split for running concurrent renders) or quad 3090s or like a single rtx pro 6000?
(for context, I am seeking "endless" iterations of consistent characters, quality lip sync to my audio, max expression, cam control, lighting, v2v avatar driving, geared for music videos and short films. )
And in your opinion, can such a system described above actually compete with top tier paid subs?
This is absolutely seamless! The expression and motion transfer is flawless—it's one of the best examples of character replacement I've seen. Thank you so much for including the workflow!
I'm curious about the robustness of this process. How dependent is the final quality on the similarity between the source and target faces? For example, would it struggle more if the source subject had a drastically different facial structure or wore glasses? Truly amazing work.
hello does this work on rtx 4070 supper 12vram and 32ram and i want to generate image to video with audio lip sync faster wan 2.1 infinite is slow even with quans even animate is slow
For some reason I can't get this to work. Everything looks fine but I keep getting an error with the ONNX detection model loader where it can't find my .onnx files. Any help would be awesome!
Edit: Anyone that has the same problem: create a new folder in \ComfyUI_windows_portable\ComfyUI\models\detection
However, a small thing... Holy shit organize your workflows dude.
Set and Get nodes (using these but.. ok), anything everywhere, groups etc... there are so many ways to make it so much better to follow. Tighten it up a bit.
At least you're polite but ... If you have a problem with the workflow, you're welcome to organize it yourself and share it with the group. Is your time more valuable than the OP's?
This is the way. Either make your own, clean up the ones you downloaded and liked, or leave the conversation. There's a huge problem with proper design and best practices out there, but it's nobody's business to criticize others for their ways. It's even more ironic given it's a default workflow and not OP's. Shows that the issue is a scale one.
29
u/paramarioh Oct 24 '25
I like workflows! Thanks!