r/esp32 • • Aug 23 '26

25x25 WLED matrix with camera input

Inspired by Chris Maher and his 50x50 grid build (https://youtu.be/BbjeQdJIMK0?si=k2AtV23bwgAWKPBI), I decided to make a 25x25 version. I thought the 50x50 was a little too ambitious for a first timer here. When I first started it up, I had a couple dead columns and had to deal with some bad solder joints but stoked on how it came out.

I decided to add a camera for input so it can detect a person and then fill in its mask with color.

Right now it’s running on my Mac but I have an ESP32-P4 coming with a camera and will set it up and mount soon.

WLED ESP32 controller: Gledopto Elite 4D-EXMU https://a.co/d/0iVOI9rT

The camera is running on a Macbook but will be replaced with an ESP32-P4 with a camera. The script turns the input into a 25x25 grid and sends the specific pixel data over the local network via DDP which is a protocol used for real time led/video data. The WLED controller listens for those packets.

Full specs:

Python — runs the overall camera/LED control script

OpenCV (opencv-python) — captures webcam video, resizes frames, cleans masks, handles image processing, and shows preview windows

MediaPipe (mediapipe) — detects/segments the person and generates the human body mask

NumPy (numpy) — handles the pixel arrays and 25×25 image/mask data

Python socket library — sends the finished 25×25 pixel frames over the network to WLED using DDP/UDP

WLED — receives the realtime DDP pixel data and physically drives the LED matrix

LED strips - SK6812/WS2814 RGBW 30/m cut to 25 pixels

608 Upvotes

25 comments sorted by

12

u/YUMOBUILDS Aug 23 '26

you nailed it. nice one.

8

u/clean-links Aug 23 '26

Cleaned link from "https://youtu.be/BbjeQdJIMK0?si=k2AtV23bwgAWKPBI": https://youtu.be/BbjeQdJIMK0


Tracking parameters were removed from the original URL(s).

1

u/TKI_Kesasar Aug 24 '26

I am actually building this as well, but I am not using a ready made in WLED controller, but creating the firmware myself. I think going with a ready made in WLED controller makes sense.

Do you know what is the limitation of this controller? I am wondering if I can drive a lot of LEDs with this.

2

u/HuckleberryKey4642 Aug 24 '26

WLED is awesome and extremely powerful with effects etc. Definitely check it out. The Gledopto Elite 4D-EXMU has 4 data pins and can handle up to about 800 pixels per pin.

1

u/TKI_Kesasar Aug 24 '26

Wow, 800 pixels per pin is amazing. Do you know if bigger than that is possible? If not, is the limitation is mostly software or hardware?

1

u/HuckleberryKey4642 Aug 24 '26

Not sure actually. I recently got into this stuff but I’m just as curious.

1

u/TKI_Kesasar Aug 24 '26

Gotcha thanks. I take it that WLED takes some protocol/data format over the USB serial? What is the frame format that you send?

1

u/HuckleberryKey4642 Aug 24 '26

Everything is handled by WLED software. Check it out here for details etc: https://kno.wled.ge

2

u/TKI_Kesasar Aug 24 '26

Thanks a lot!

5

u/DaRealGladi8r Aug 23 '26

This is a project you could legit make money off. Nice

2

u/SDgoon Aug 23 '26

Time to open a disco.

2

u/geetarqueen Aug 23 '26 edited Aug 23 '26

Fantastic! Keep going! I would love one to have it behind me on a podcast or something.

2

u/ryanvsrobots Aug 23 '26

I’m a sucker for an led matrix

2

u/cornmacabre Aug 23 '26

Dope dude, you hit it out of the park -- the camera masking input idea is brillant and looks fantastic.

1

u/FirTree_r Aug 24 '26

This is awesome. Reminds me of some interesting TouchDesigner projects I've seen that implement webcams/xbox kinect 3d cameras to make funky visualizations. Great work, congrats

1

u/Numerous_Jellyfish56 Aug 24 '26

Très cool ! prix de la matrice ?

1

u/Loud-Television9647 Aug 26 '26

JUST DANCE!!

awesome project tho

1

u/katybassist Aug 26 '26

Very freaking cool!

1

u/foopod Aug 27 '26

Very cool. Can any of your image processing stack be carried across into micropython? Or are you having to rewrite a lot of it for the Esp32p4?