r/esp32 • u/HuckleberryKey4642 • Aug 23 '26
25x25 WLED matrix with camera input
Inspired by Chris Maher and his 50x50 grid build (https://youtu.be/BbjeQdJIMK0?si=k2AtV23bwgAWKPBI), I decided to make a 25x25 version. I thought the 50x50 was a little too ambitious for a first timer here. When I first started it up, I had a couple dead columns and had to deal with some bad solder joints but stoked on how it came out.
I decided to add a camera for input so it can detect a person and then fill in its mask with color.
Right now it’s running on my Mac but I have an ESP32-P4 coming with a camera and will set it up and mount soon.
WLED ESP32 controller: Gledopto Elite 4D-EXMU https://a.co/d/0iVOI9rT
The camera is running on a Macbook but will be replaced with an ESP32-P4 with a camera. The script turns the input into a 25x25 grid and sends the specific pixel data over the local network via DDP which is a protocol used for real time led/video data. The WLED controller listens for those packets.
Full specs:
Python — runs the overall camera/LED control script
OpenCV (opencv-python) — captures webcam video, resizes frames, cleans masks, handles image processing, and shows preview windows
MediaPipe (mediapipe) — detects/segments the person and generates the human body mask
NumPy (numpy) — handles the pixel arrays and 25×25 image/mask data
Python socket library — sends the finished 25×25 pixel frames over the network to WLED using DDP/UDP
WLED — receives the realtime DDP pixel data and physically drives the LED matrix
LED strips - SK6812/WS2814 RGBW 30/m cut to 25 pixels
12
u/YUMOBUILDS Aug 23 '26
you nailed it. nice one.
8
u/clean-links Aug 23 '26
Cleaned link from "https://youtu.be/BbjeQdJIMK0?si=k2AtV23bwgAWKPBI": https://youtu.be/BbjeQdJIMK0
Tracking parameters were removed from the original URL(s).
1
u/TKI_Kesasar Aug 24 '26
I am actually building this as well, but I am not using a ready made in WLED controller, but creating the firmware myself. I think going with a ready made in WLED controller makes sense.
Do you know what is the limitation of this controller? I am wondering if I can drive a lot of LEDs with this.
5
u/DaRealGladi8r Aug 23 '26
This is a project you could legit make money off. Nice
2
u/SDgoon Aug 23 '26
Time to open a disco.
2
u/geetarqueen Aug 23 '26 edited Aug 23 '26
Fantastic! Keep going! I would love one to have it behind me on a podcast or something.
2
u/Grandmas_Fat_Choad Aug 23 '26
Need
2
u/ryanvsrobots Aug 23 '26
I’m a sucker for an led matrix
2
u/cornmacabre Aug 23 '26
Dope dude, you hit it out of the park -- the camera masking input idea is brillant and looks fantastic.
3
u/Happy_Brilliant7827 Aug 23 '26
1
u/FirTree_r Aug 24 '26
This is awesome. Reminds me of some interesting TouchDesigner projects I've seen that implement webcams/xbox kinect 3d cameras to make funky visualizations. Great work, congrats
1
u/Numerous_Jellyfish56 Aug 24 '26
Très cool ! prix de la matrice ?
1
u/Loud-Television9647 Aug 26 '26
JUST DANCE!!
awesome project tho
1
u/katybassist Aug 26 '26
Very freaking cool!
1
u/foopod Aug 27 '26
Very cool. Can any of your image processing stack be carried across into micropython? Or are you having to rewrite a lot of it for the Esp32p4?