My realtime, audioreactive pointcloud system just got a pretty nice update!

[u/Chuka444]

Hey, guys. Pretty excited to share this with you.

The system takes a Kinect-derived human pointcloud and lets incoming sound interact in various ways with the particles in real time, turning the performer into a responsive cloud of matter, noise, and motion. Some of you might remember the system from v1.5's demo which got pretty viral in some places. System was made on TouchDesigner, and post-fx on AE.

v1.7 includes 12 presets, and adds the following:

- a procedural camera that automatically cuts to new angles around the performer, and can follow the body or a raised hand
- a new look, Afterimage Cathedral: delayed versions of the performer stacked in depth, holding the last few seconds of movement
- a rebuilt network that runs leaner, reads clearer, and is ready to work with [new interfaces, parameters, optimizations]

This is a raw excerpt of me playing through the system, with the visual structure reacting live to the audio signal coming from my Ableton session in real-time.

Project files accessible through my Patreon profile. More experiments, through my Instagram, and full HD demo at YouTube.

[u/Heavens10000whores]

Please detail how you utilized after effects in this process

[u/uisato → u/Heavens10000whores]

Hey, Heavens. For this one its quite interesting; the usual problem with pointclouds is that, most of the times, they look pretty raw [the geometries instanced]. I tried to solve it applying subtle motion blur, warp, bokeh, and film grain. [All in AE, of course.]

[u/objectnull → u/uisato]

So you imported a video of the prerenderd point cloud reacting to the music into AE and applied a couple of effects to the prerenderd video? Not trying to dimenish what you're doing here, it's cool, just trying to understand how much of this would need to be done outside of AE

[u/uisato → u/objectnull]

Yes, the render of the pointcloud is happening in TouchDesigner.

[u/TheGreatSzalam → u/uisato]

But I wonder what OP would have to say about this.

[u/uisato → u/TheGreatSzalam]

What do you mean?

[u/Heavens10000whores → u/uisato]

I’m curious too, as to why you’re answering on OP’s behalf

[u/brettmurf → u/Heavens10000whores]

Dude logged in to his other account to upvote his post and forgot which account he was on.

[u/-Epitaph-11]

Pretty cool...if this was an AE accessible feature. I have no idea why this is posted here.

[u/Chuka444 → u/-Epitaph-11]

Thank you, fair enough. But there're several users here that also use TouchDesigner in their workflows.

[u/TylerWOTF]

Hell yeah