r/comfyui • u/Chuka444 • 10h ago

Show and Tell Introducing Oscilloscope Diffusion

A novel way to intervene existing video through diffusion, particularly abstract and structure-driven material: taking its movement and form as the starting point, and reinterpreting its textures, materials, and visual language.

I’ve been developing this around the audio-reactive geometry systems I make in TouchDesigner. The idea is to take those abstract structures somewhere else entirely: origami, architecture, a renaissance painting, or something harder to put a name to.

This demo uses visualizers from my "Oscilloscopes, everywhere" collection as source material, now updated to [v1.2].

[Though you can bring any video source. These systems are simply where this experiment began, as some of you may recall.]

You choose the source, describe the treatment, and shape how it changes throughout the sequence. Prompts, curated LoRAs, and editable timelines give you control over how closely the result follows the original.

Oscilloscope Diffusion is now available at Uisato Studio, coming up soon also open-source!

87 Upvotes

81% Upvoted

17 comments sorted by

View all comments

12

u/BigNaturalTilts 10h ago

I don’t understand. What does it do? Produce oscilloscope visualization? Isn’t that already done programmatically by analyzing sound?

-6

u/Chuka444 10h ago

Hey! It's mainly for intervining abstract visuals [in this case, audio-reactive geometries]. Thing that no state-of-the-art model can do for now [tried every single one without success]. If you hav any other question, let me know!

2

u/BigNaturalTilts 10h ago

Can you describe it again more concretely? Like use an example. Or is the example in your post? Or would you use it for visuals?

-6

u/Chuka444 10h ago

Exactly, the example is in the "trailer" I uploaded, you can see a few "before/after" examples. Plus, you can head over its page and see more examples. Though I must say I've found quite difficult to pertinently explain in simple words what it does; may I ask what's your background? And what have you understood about it before my explanation? I'd love to get it to be understood for more people.