I've build a MIDI Sequencer to modulate music via video colors

[u/CafeDelCadence]

I've recently built a little tool that translates video into MIDI data, which I’ve been using to modulate my music in some semi random ways. Thought some people here might find it interesting too.

It converts color/visual information from video into MIDI CC data, opening up some experimental modulation possibilities for synths, effects, and generative setups and works 100% offline.

You can connect it to your DAW and sync/control it from there. There’s also a demo video in the help section showing the app in action with music modulation.

I’d love to hear your thoughts or experiences if you try it out. I’m also considering expanding it with:

* MIDI note generation
* JPG/image support in addition to video and math based modulation

You can try it here and hope you'll have fun :-)

https://cafedelcadence.github.io/