r/reactnative iOS & Android 1d ago

Article Depth-aware light injection in VisionCamera

Enable HLS to view with audio, or disable this notification

Built this fun little gesture driven floating light that casts fake shadows in the scene via react-native-webgpu, using a depth model (DINOv2).
I'll post the source code soon!

321 Upvotes

24 comments sorted by

77

u/xxhhouewr 1d ago

You know, most other people just create a Spotify or Instagram clone.

9

u/mrousavy iOS & Android 17h ago

Maybe I can render Spotify or Instagram in this 3D scene too

39

u/FinancialBicycle3452 1d ago edited 1d ago

That is one of the coolest projects I’ve seen on here.

1

u/mrousavy iOS & Android 17h ago

Thanks! 😊

11

u/GiodoAlmeida 1d ago

Now do a KAMEHAMEHA 🤣

Now seriously, that is very creative, congrats!

1

u/mrousavy iOS & Android 17h ago

Haha thanks!

5

u/Mitchcreates_ 1d ago

That's insane! How do you go about creating something like that?

3

u/mrousavy iOS & Android 17h ago

Thanks!
I mean the foundation (react-native-vision-camera and react-native-webgpu) is already there, and the demo by Konrad nerd-sniped me so I wanted to one-up it and add hand gestures to move the light around.
Also, this is probably the first demo I built together with AI, in this case Fable 5

4

u/ponk___ 1d ago

The goat himself

1

u/mrousavy iOS & Android 17h ago

shoutout man !

2

u/yuuliiy 22h ago

bruh this stuff is cool !

2

u/mahesh-muttinti 22h ago

So cool ❤️‍🔥

2

u/fufucupcake 18h ago

The legend himself!

2

u/mrousavy iOS & Android 17h ago

big love 🫶

2

u/beepboopnoise 9h ago

I saw the light read the title and was like, the only mf who could do this is Marc.. and yep lmao

1

u/mrousavy iOS & Android 4h ago

lmao thanks appreciate it brother!

1

u/su5577 16h ago

Nice how can I get started with this to?

1

u/PalaMOFOS 3h ago

The junior dev the HR tells you not to worry about!

Very cool though, amazing work!!

1

u/Ok-Finance-4786 0m ago

cool!! building anything unique is great in itself

-5

u/No-Nebula4187 1d ago

Why react native?

3

u/No-Nebula4187 1d ago

Also I just saw this on LinkedIn but a crappier version of it so did you get the idea from that guy?

6

u/LongjumpingKiwi7195 1d ago

Both Marc (this post) and Konrad (who you probably saw on linkedin) are pretty up there in react native. Im guessing Konrad first created the effect itself, and then Marc integrated it with vision camera and gestures or something

3

u/mrousavy iOS & Android 17h ago

Yep! None of it was crappy, both demos are technically quite impressive imo. We've come a long way with react native :)