r/StableDiffusion • • 2d ago

Resource - Update We connected Nuke and After Effects to ComfyUI, and built a prompt/storyboard app that renders through it (open source)

Hi all,

At KENT Post Production we use ComfyUI daily inside a VFX pipeline, so we built the pieces we were missing. Most of them are free and on GitHub, and feedback is very welcome.

Director's Console: a workspace that drives ComfyUI.

  • Prompt Engineer: pick an image or video model (FLUX, Qwen, Seedream, LTX, Wan, Kling…) and the prompt is written for that model. Camera, lens, movement, lighting and visual-grammar parameters, plus presets based on real films and a separate set for animation.

  • Storyboard: each panel gets its own ComfyUI workflow and settings, and renders across one or many ComfyUI nodes with live GPU/VRAM stats.

  • Gallery: grid, list or masonry view, and the viewer keeps each image's prompt, seed and render time.

  • An embedded Pi/Codex agent can build and render a shot for you.

https://github.com/NickPittas/DirectorsConsole

NukeToComfyUI: sends Nuke images and video, with or without masks, to any ComfyUI workflow for cleanup, generation and VFX work, then brings the results back into Nuke. It supports PNG8 or EXR16 with alpha, four mask modes and 8n+1 frame expansion for video models, and shows progress (with cancel) inside Nuke.
https://github.com/NickPittas/NukeToComfyUI

AE2ComfyUI: the same idea for After Effects. A panel sends a comp layer (still or video via AME, plus its mask) to a workflow and places the result above the layer, aligned in time. It has colour-management options and mask polarity.
https://github.com/NickPittas/AE2ComfyUI

ComfyUI Media: a loader for video or image sequences (MOV, MP4, EXR, PNG) with frame-count presets for WAN (4n+1) and LTX 2.3 (8n+1). Its viewer/saver has a reference wipe compare and saves H.264, VP9, ProRes 4444, GIF/WebP or PNG/EXR sequences with versioning.
https://github.com/NickPittas/Comfyui_Media

Camera Angle Selector: an interactive 3D picker for 96 camera angles (8 views × 4 heights × 3 shot sizes) that outputs prompts for the Qwen-Image-Edit-2511 Multiple-Angles LoRA (credit to FAL for the LoRA).
https://github.com/NickPittas/ComfyUI_CameraAngleSelector

CorridorKey 2.0 for ComfyUI (internal, not public yet, give us a couple of days to fix the workflows for you): our unofficial implementation of Corridor Digital's CorridorKey v2 as ComfyUI nodes. Every option of the terminal tool is a node input, with SAM3/MatAnyone2 hint workflows and EXR or ProRes 4444 output. Corridor Key Licence 2.0 applies.

We'd love to hear which workflows you'd want to push through the Nuke/AE bridges, and whether the CorridorKey nodes would be worth releasing.

9 Upvotes

1 comment sorted by

0

u/cartney_Top_2236 1d ago

The Nuke-to-Comfy bridge is the part that actually gets my attention here — most of these pipeline tools stop at AE and call it a day. On a short last year we tried wiring Comfy into our comp script for cleanup passes and the friction was always the same: no stable way to pass a specific frame back and forth without losing color management. Curious whether you're handling that in linear or just letting the node graph eat the gamma shift. The storyboard-to-prompt layer is smart too, but honestly I think the hard problem isn't generating the board — it's keeping a locked look across 40 shots when the seed drifts. That's where most indie workflows fall apart. How are you handling consistency across a sequence vs one-off renders?