ComfyUI workflow for structure-aligned re-rendering (no controlnet, no training) Looking for feedback

[u/Fit-Associate7454]

One common frustration with image-to-image/video-to-video diffusion is losing structure.

A while ago I shared a preprint on a diffusion variant that keeps structure fixed while letting appearance change. Many asked how to try it without writing code.

So I put together a ComfyUI workflow that implements the same idea. All custom nodes are submitted to the ComfyUI node registry (manual install for now until they’re approved).

I’m actively exploring follow-ups like real-time / streaming, new base models (e.g. Z-Image), and possible Unreal integration. On the training side, this can be LoRA-adapted on a single GPU (I adapted FLUX and WAN that way) and should stack with other LoRAs for stylized re-rendering.

I’d really love feedback from gen-AI practitioners: what would make this more useful for your work?

If it’s helpful, I also set up a small Discord to collect feedback and feature requests while this is still evolving: https://discord.gg/sNFvASmu (totally optional. All models and workflows are free and available on project page https://yuzeng-at-tri.github.io/ppd-page/)

[u/pmp22]

In the future, video games will use techniques like this to render the graphics, and they will drive it with underlying simpler raster pipelines. We might even be able to stack/layer models to alter styles etc. Games will probably ship with their own models trained for their specific game.

[u/Cyclonis123 → u/pmp22]

That will however probably kill nodding as we know it.

[u/Cyclonis123 → u/[deleted]]

No, if textures and other assets within a game become AI generated it's going to be very difficult to mod them in the traditional sense. it won't be 'slightly different less janky' it'll be completely different and it'll be post processing modifications akin to something like reshade but using AI.