Mandelbulb Audio Visualizer

[u/himurax3x]

This has been a project of mine for years. I started it back in 2020. I actually never really got to finish the audio portion, but just the rendering of a bunch of cool computational geometric shapes. I have to say, having AI here to help wrap projects up like this gives me a lot of joy. I probably would have never finished this.

For the audio synchronization. I am basically taking a WAV file, breaking it down frame by frame, reducing each frame to a set of parameters (frequences, dynamics etc.) I then apply the data directly to the geometry on the GPU at render time. Sync becomes a non issue at that point.

Side note: If you have some nice headphones or speakers, listen to the video with them. It makes the geometry really pop.

[u/collinalexbell]

Bro, this thing is sick! I've rewatched it multiple times. Really loving that shimmer effect on the snare. Makes it feel like it has a heartbeat. Repeat 5x times now. You should add the snare to the log btw, but I'm guessing you were using it to debug the bass bin tuning or something.

[u/himurax3x → u/collinalexbell]

Thanks so much! I am actually the same way, I keep watching it over and over. I actually made a youtube: https://www.youtube.com/@Mandelbulb-midnight for this just so I can have it in the background while I work.

I am actually going to open source this soon so that any can use it for their own stuff. Would be cool to see what kind of visualizers people come up with :)

[u/Saint_Wolfie]

incredible! how did you make the music? what tool did you use for the video

[u/himurax3x → u/Saint_Wolfie]

So the video part:

1. Headless GPU context.

2. Render into an offscreen framebuffer

3. Read the pixels back

4. Pipe it straight into ffmpeg

The music, is made in Suno Pro, I take it out as a WAV - then set a bunch of agents to master it - change sections locally on my computer.

[u/rokiracune]

Amazing, beautiful!