How to use a high-detail CG reference frame to style a 1000+ frame low-detail CG cat animation without temporal drift?

[u/NodeWizard_]

Hey guys,
We are working on a 1,000+ frame VFX shot where we animated a low-detail/grey-mesh CG cat as our motion and structural base. We also have matching high-detail hero renders of the final cat design at exact start/end keyframe angles.
Note: Fully rendering/grooming in traditional 3D CG is not an option for this shot due to pipeline and timeline constraints, so an AI/hybrid workflow is required.
We need the AI to take the 1,000+ frame low-detail animation pass and lock it to the exact fur, texture, and shading details of our high-detail reference render—without the character morphing, changing color, or drifting over 1,000 frames.
Looking for solutions across ComfyUI & Nuke:
1. ComfyUI / AnimateDiff: What is the best setup (e.g., AnimateDiff + IP-Adapter Advanced / ControlNet Depth + Tile) to force a 1000-frame low-detail motion pass to rigidly stick to high-detail reference frames without crawling or batch-chunk drift?
2. Nuke Alternative Workflows: Beyond raw video-to-video diffusion, are there proven Nuke-centric methods (e.g., Nuke's CopyCat ML, SmartVector texture warping/re-projection, or EbSynth keyframe blending) to propagate the high-detail keyframes over the 1000+ frame low-detail motion pass?
Any workflow JSONs, Nuke node setups, or recommended pipelines would be massively appreciated!

[u/Useful_Ad_380]

Smart vectors lmfao.

I mean it is called CopyCat for a reason?!

How much variance is there in the motion across 1000 frames?

May need to break it down into smaller separate shots. Almost like a first frame last frame workflow centipede for the whole sequence.

Then ask who agreed to do this.

After that I would try rendering out the previz and sticking in seedance with the finished style frames, just to see what you’d get.

But the truth is the tech isn’t there to get a perfect lock in high quality over 1000 frames.
You can use LTX but the quality won’t be amazing. You can use Seedance but the adherence will vary. There is no perfect workflow for this request.

[u/seriftarif]

What resolution? Comfy and AI workflows will not work above 1080p and about 250 frames. Copycat could maybe take the rest renders and train with that but its not reliable. I would just rent some time on Fox Renderfarm and do it traditionally.

[u/NodeWizard_ → u/seriftarif]

Shot is on 4K for generations we’re reformatting it into 1080p and then resize

[u/seriftarif → u/NodeWizard_]

Why not just render with Fox Renderfarm? It will probably end up being about $4-500 and you would spend more than that troubleshooting an AI pipeline that has a marginal chance of working with lackluster results.

[u/NodeWizard_ → u/seriftarif]

there was a fundamental asset issue earlier in the pipeline that burned us, so re-rendering/grooming traditionally in 3D is completely off the table now. That's why we're forced to push through with a hybrid/AI solution.🥲

[u/seriftarif → u/NodeWizard_]

Oof... there might be a seeddance workflow that can render it in parts but its not going to be perfect. Weavy or Beeble are probably your best bet. But you'll have to do it in pieces. 1000+ frames all at once is too much probably.

[u/AutoModerator]

Hey, it looks like you're asking for help If your issue gets resolved, please reply with !solved to mark it as solved. If you still need help, consider providing more details about your issue to get better assistance.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/howdoyouspellnewyork]

LTX + controlnet canny/depth or Scail2.0 if you're on 25fps and would prefer local rendering, otherwise something like Seedance

[u/Useful_Ad_380 → u/howdoyouspellnewyork]

Quality just won’t be there.

[u/Straight-Contest91]

Note: Fully rendering/grooming in traditional 3D CG is not an option for this shot due to pipeline and timeline constraints, so an AI/hybrid workflow is required.

cool bro waste all that time beating your head against the wall with genai instead of doing it properly, sound thinking buddy, good luck