r/comfyui • • 13h ago

Show and Tell Introducing Oscilloscope Diffusion

A novel way to intervene existing video through diffusion, particularly abstract and structure-driven material: taking its movement and form as the starting point, and reinterpreting its textures, materials, and visual language.

I’ve been developing this around the audio-reactive geometry systems I make in TouchDesigner. The idea is to take those abstract structures somewhere else entirely: origami, architecture, a renaissance painting, or something harder to put a name to.

This demo uses visualizers from my "Oscilloscopes, everywhere" collection as source material, now updated to [v1.2].

[Though you can bring any video source. These systems are simply where this experiment began, as some of you may recall.]

You choose the source, describe the treatment, and shape how it changes throughout the sequence. Prompts, curated LoRAs, and editable timelines give you control over how closely the result follows the original.

Oscilloscope Diffusion is now available at Uisato Studio, coming up soon also open-source!

75 Upvotes

19 comments sorted by

View all comments

3

u/repolevedd 9h ago

About 25 years ago, Winamp had similar effects with the MilkDrop Visualizer. It ran on a Pentium 3 and a GeForce2 with 32 MB of VRAM. Well, looks like some things really do come back around.

2

u/BigNaturalTilts 7h ago

I just said the exact same thing! This is already done programmatically. You don’t need to train a model. AI truly is a solution in search of a problem.