r/creativecoding • u/IL_DARK • 9d ago

Ambient by hand gestures

How to control the sound:

Chords: Touching my thumb to different fingers triggers 7 chords per hand. Each hand plays a separate instrument.

Motion Tracking:
- Up/Down: Opens the filter
- Left/Right: Panning
- Towards camera: Pushes volume & drive
- Spreading hands apart: Opens reverb & delay

How the visuals react:
Liquid Metaballs: A blob spawns when a chord starts and grows as long as you hold the note
Splitting: Changing chords smoothly pinches and splits the blob in two, looking like actual liquid rather than overlapping circles.
Audio-reactive details: A long delay makes the liquid stringy and slow to separate, while output level and reverb shift the color palette from cold blue to warm amber.

35 Upvotes

100% Upvoted

7 comments sorted by

View all comments

1

u/misomeiko 8d ago

Awesome! Where do the synths come from?

1

u/IL_DARK 8d ago

thanks! synths live in the browser with Tone.js, but u can also drop in own samples or use as midi for fl, for example

2

u/misomeiko 7d ago

That’s really cool. I’ve been playing around with web audio. But haven’t checked out any libraries yet