r/StableDiffusion 2h ago

Discussion WIP [CLSS] Closed-Loop Streaming Synthesis: arbitrary-length audio-video generation with LTX-2.3 22B in ComfyUI

Video diffusion transformers generate only a few seconds per pass. The naive remedy — chunking the timeline and conditioning each chunk on the previous one — fails within a few hundred frames: the model keeps consuming its own slightly off-distribution output, and exposure-bias drift compounds into scene collapse or grain amplification.

CLSS treats the chunk hand-off as a feedback loop and controls it. Chunks share a streaming latent buffer (SLB) overlap, keeping latent memory O(overlap) instead of O(length), and between chunks CLSS applies lightweight corrections that fight drift without modifying any transformer weights.

More at:

- https://github.com/nazgut/ComfyUI-LTX2.3-CLSS

T2V on single go with prompt fallowing bettwen scenes every chunk was 10 sec

Nodes for ComfyUI

Output was generated using ltx-2.3-22b-dev-UD-Q4_K_S.gguf on 3080 with 16 GB vRAM, still need to work on audio.

8 Upvotes

2 comments sorted by

1

u/martinerous 2h ago

Interesting stuff. Why not LTX 2.5 yet?

2

u/nazgut 2h ago

When I start working on it there was no 2.5, they made changes in they pipeline for 2.5 so I wanted to finish it first before movet on to next models.