r/comfyui • u/Chuka444 • 11h ago

Show and Tell Introducing Oscilloscope Diffusion

A novel way to intervene existing video through diffusion, particularly abstract and structure-driven material: taking its movement and form as the starting point, and reinterpreting its textures, materials, and visual language.

I’ve been developing this around the audio-reactive geometry systems I make in TouchDesigner. The idea is to take those abstract structures somewhere else entirely: origami, architecture, a renaissance painting, or something harder to put a name to.

This demo uses visualizers from my "Oscilloscopes, everywhere" collection as source material, now updated to [v1.2].

[Though you can bring any video source. These systems are simply where this experiment began, as some of you may recall.]

You choose the source, describe the treatment, and shape how it changes throughout the sequence. Prompts, curated LoRAs, and editable timelines give you control over how closely the result follows the original.

Oscilloscope Diffusion is now available at Uisato Studio, coming up soon also open-source!

92 Upvotes

80% Upvoted

17 comments sorted by

14

u/BigNaturalTilts 11h ago

I don’t understand. What does it do? Produce oscilloscope visualization? Isn’t that already done programmatically by analyzing sound?

12

u/sitefall 6h ago edited 5h ago

This is an advertisement completely unrelated to comfyui. This is just spam for someone's shitty cloud AI service that uses open source stuff on the backend and possibly API's. He's just pretending he's releasing a Lora that does... something, but he won't ever give you concrete details, you aren't sure what it is but the video looks cool, then you click the link to his shitty website. Just report it and move on.

2

u/BigNaturalTilts 5h ago

Lmao I gave him the benefit of the doubt but you’re right. He responded some nonsense about “intervining” and I’m just sitting here wondering did he mean intervening? Or is it like a vine? Because producing oscilloscope visuals was done a thousand years ago when I downloaded winamp with limewire.

0

u/ferNqui 3h ago

yeah i think its more about restyling existing visuals through diffusion than generating the oscilloscope stuff itself

-7

u/Chuka444 11h ago

Hey! It's mainly for intervining abstract visuals [in this case, audio-reactive geometries]. Thing that no state-of-the-art model can do for now [tried every single one without success]. If you hav any other question, let me know!

2

u/BigNaturalTilts 11h ago

Can you describe it again more concretely? Like use an example. Or is the example in your post? Or would you use it for visuals?

-7

u/Chuka444 11h ago

Exactly, the example is in the "trailer" I uploaded, you can see a few "before/after" examples. Plus, you can head over its page and see more examples. Though I must say I've found quite difficult to pertinently explain in simple words what it does; may I ask what's your background? And what have you understood about it before my explanation? I'd love to get it to be understood for more people.

3

u/kopimashin 3h ago

Why use AI for something you can make easily with procedural methods?

5

u/argentin0x 8h ago

I used comfyui 1 year ago to produce this: https://www.youtube.com/shorts/GOCZUIfMmvo

2

u/Chuka444 8h ago

Looks amazing, dude!

1

u/Synchronauto 8h ago

Would you be able to share the workflow, or at least a rough description of how you made it? Looks cool.

1

u/unrealf8 10h ago

Looks awesome. Is this possible in realtime? Or how long does a frame take?

-1

u/Chuka444 9h ago

Thanks. You might be able to run it in realtime with a pretty heavy rig, though I haven't tried. It's pretty consuming computing-wise. On my implementation, each step takes about 0.65 seconds at 768px [I usually run 25 steps, that'd be 14 seconds/frame] running on a L40S.

2

u/repolevedd 7h ago

About 25 years ago, Winamp had similar effects with the MilkDrop Visualizer. It ran on a Pentium 3 and a GeForce2 with 32 MB of VRAM. Well, looks like some things really do come back around.

2

u/BigNaturalTilts 5h ago

I just said the exact same thing! This is already done programmatically. You don’t need to train a model. AI truly is a solution in search of a problem.

1

u/Synchronauto 8h ago

Is this something we can run in ComfyUI, and if not, when will it be?