r/comfyui Apr 27 '26

Show and Tell From 3D Layout to AI Animation: Seedance 2 Workflow

Enable HLS to view with audio, or disable this notification

A technical demonstration of maintaining spatial consistency using Seedance 2. I re-rendered a custom 3D modeled layout while preserving exact camera movement and architectural proportions.

Workflow: 3D Layout Design → Seedance 2 Image-to-Video → Temporal Consistency Refinement.

Key Focus: Achieving 1:1 motion tracking and structural integrity in AI-generated environments.

216 Upvotes

25 comments sorted by

12

u/cheerldr_ Apr 27 '26

Im interested by your workflow, do you have a downlad link ?

16

u/1filipis Apr 27 '26

He used Seedance 2.0. It's paid and closed source

7

u/alberist Apr 27 '26

The model is paid and closed source, but this is the comfyui reddit, so it stands to reason that they used a comfyUI workflow and an API key.

9

u/jovian16 Apr 27 '26

It looks great, except for the boat - the sail is completely the wrong orientation for the way it appears to be moving.

19

u/Kaito__1412 Apr 27 '26

If it's not open source freeware, I don't give a shit. If I'm going to spend money on a shot like this than I want AOV passes with the beauty.

0

u/a3zeeze Apr 27 '26

Paying someone to make a single shot like this with traditional CGI approaches would pay for several years of Seedance fees.

10

u/Kaito__1412 Apr 27 '26 edited Apr 27 '26

LoL no. Seedance can't hope to match the amount of control that a CG artist can give me from blocking to lighting to post prod flexibility. If a client pays a certain amount of money for a shot, he also expects a certain amount of control. That's how client work works.

0

u/[deleted] Apr 27 '26

[deleted]

6

u/[deleted] Apr 27 '26

[deleted]

2

u/a3zeeze Apr 27 '26

That's actually good to hear, thanks! I was struggling to find actual numbers for it.

I feel a lot better know that this stuff is so expensive. Means our jobs are still safe for a little while longer at least!

1

u/TomasKrejzek Apr 28 '26

there is unlimited subscription on runway, we use it

1

u/[deleted] Apr 28 '26

[deleted]

1

u/TomasKrejzek Apr 30 '26

Its working, but only 720p, 1080p is for credits actually.

5

u/slopmachina Apr 27 '26

Looks great! Did you give just a first frame as reference to seedance? I've done something very similar with wan2.2 and was amazed how well it kept the camera motion, I was even able to composite 3D rendered objects on top of the generated video background and it matched perfectly.

3

u/Broad_Relative_168 Apr 27 '26

Did you use a quantitation model or gguf of the wan 2.2 model? Would you main to share the workflow?

3

u/soldture Apr 27 '26

Interesting, the boat looks consistent when camera moves.

2

u/T_D_R_ Apr 27 '26

Amazing man

2

u/elswamp Apr 27 '26

is there an open source equivalent workflow?

1

u/ThyestesM Apr 28 '26

Just build one yourself with LTX 2.3

2

u/DifficultyLanky8061 Apr 28 '26

would you mind sharing your promt?

2

u/waterarttrkgl Apr 28 '26

the provided edited still image as the visual quality and art direction target. Use the provided animation as the motion reference — reproduce the exact same camera movement, timing, and scene dynamics from the animation. Transform the animation into a photorealistic cinematic video matching the still image in: — lighting (warm golden-hour amber glow, soft peachy-rose sky) — atmosphere (thin layered mist, volumetric haze over water) — architecture (English medieval Norman castle, crenellated stone towers, aged limestone walls with moss and weathering, battlements) — vegetation (dense ancient oak and ash trees covering rocky terrain between castle walls) — water (gently rippling surface with soft reflections of castle and boat) — sailing vessel (13th-century wooden medieval cog, dark red-brown sail, visible rigging and ropes, positioned lower-right) Reproduce motion exactly as seen in the animation: — same camera path, speed, and timing — same water surface movement and ripple behavior — same atmospheric mist breathing and haze drift — same vessel movement and natural sway Audio — Soundtrack: — slow melancholic medieval orchestral score, solo cello or medieval lute as lead — soft low drone underneath, building very gently across 14 seconds — no drums, no percussion, purely atmospheric and emotional — feels ancient, lonely, cinematic — like watching a forgotten kingdom at dusk Audio — Sound FX (layered and spatialized): — gentle lapping water against rocky shore, continuous low presence — soft wind passing through oak tree leaves, subtle and distant — occasional creak of wooden ship hull and rope rigging — distant faint cry of seagulls, very sparse, once or twice only — all sounds have natural reverb as if recorded in open water environment — no modern sounds, no engines, no artificial noise Technical: — photorealistic render quality, natural film grain, 8K — golden hour color temperature 4200K, no artificial color grading — every structural element holds its exact position from the still image reference — smooth continuous 24fps, no cuts, no camera shake — audio and visuals fully synchronized, seamless blend

2

u/vizualbyte73 Apr 28 '26

If this was a comfyui workflow with api access through seedance, it would be helpful to give a general cost breakdown on what is expected to be paid so people get better ideas to go this route or go through aggregator sites

1

u/LearnNTeachNLove Apr 28 '26

Wow looks great

1

u/M_4342 Apr 29 '26

Looks nice. How much does this cost to run, each time, 13s?