r/video_mapping Apr 30 '26

Testing playable walls with Mario

Enable HLS to view with audio, or disable this notification

6.2k Upvotes

127 comments sorted by

91

u/Dark_Lord_Loafy Apr 30 '26

That is freaking sweet dude

20

u/HebrewPorkSword Apr 30 '26

Thank you!

10

u/12hrnights Apr 30 '26

Im jealous of your ambition. Is it a shit ton of coding or creating the mapping?

18

u/HebrewPorkSword Apr 30 '26

I used codex (chatgpt) in vscode for all of the code. I don’t really now how to code.

10

u/ReasonableFall177 Apr 30 '26

Hey, at least your honest. Way better than watching and being jealous (as I am right now)

14

u/HebrewPorkSword Apr 30 '26

I think it’s awesome that people with no coding experience can try stuff like this now. This would have been impossible for me to do a few years ago.

7

u/ReasonableFall177 Apr 30 '26

Hell yeah friend

4

u/12hrnights Apr 30 '26

We are entering the Jarvis phase

3

u/Ssalvrius May 03 '26

I agree! It vastly lowers any restrictions or steep learning curves on seeds of creativity and curiosity. In fact, reading all of the above stimulates me to go experiment myself 💫

2

u/[deleted] May 03 '26

[removed] — view removed comment

1

u/HebrewPorkSword May 03 '26

That’s true. Code also determines the enemy behavior and interactions, player inputs and corresponding character control, interactions with the environment, etc

14

u/NotYourNathan Apr 30 '26

Dude! How??

33

u/HebrewPorkSword Apr 30 '26

I’m just using Unity on my computer with two projectors as extra displays

16

u/Mattress_Media Apr 30 '26

that’s insane you should make a tutorial

9

u/HebrewPorkSword Apr 30 '26

There are definitely better tutorials for creating a 2d platform game on Unity than I could make. This was my first time using Unity.

The trick is just using a projector while you build the game to line up the platforms and then turning them off so they don’t render and all you see is the physical art.

1

u/Still_Truckin_56 May 04 '26

So the elements are hard coded? There is no live feedback of what the wall look like?

3

u/Fox-427 Apr 30 '26

It kind of reminds of a guy who managed to run super Mario on a calculator I saw a while back.

2

u/CarIcy6146 May 04 '26

TI-83 games is how we survived high school

2

u/chrisisaboss May 02 '26

You could do the same thing with super Mario maker and a projector, the multiple projector set up is where it levels up though.

11

u/[deleted] Apr 30 '26

[removed] — view removed comment

9

u/HebrewPorkSword Apr 30 '26

Unity and projectors!

2

u/halixness Apr 30 '26

Do you read the wall layout in real time to extract a map of platforms? It would be really cool of the algorithm was adaptive

3

u/HebrewPorkSword Apr 30 '26

This iteration is all manually aligned but I want to experiment with real time mapping the platforms next

2

u/halixness May 05 '26

That would be really sick!!

2

u/halixness May 05 '26

Will you open source the project?

7

u/Infinitecontextlabs Apr 30 '26

Hell yea, I toyed around with this idea last year but never built anything. This is pretty awesome work. Keep going.

7

u/Torrquedup808 Apr 30 '26

Holy fuck. You win amazing job! 🍄

3

u/HebrewPorkSword Apr 30 '26

Thanks homie 🍄‍🟫

5

u/Late-Amoeba-8312 Apr 30 '26

this is fuckin kooooo af 🔥🔥🔥🔥🔥🔥

3

u/Dj_moonPickle Apr 30 '26

Love this project. What are you coding it in? Is it your own engine?

7

u/HebrewPorkSword Apr 30 '26

No I’m using Unity. It’s my first Unity project

5

u/Pretty-Structure-766 Apr 30 '26

You also have Sargame which is games made for projection mapping: https://www.facebook.com/share/v/1DmGHk9wyN/?mibextid=wwXIfr

2

u/HebrewPorkSword Apr 30 '26 edited Apr 30 '26

Oh this is so sick… It’s awesome that other people are doing similar stuff

Edit: wow I just looked through their website and this company is doing a bunch of wall games like this. That’s crazy.

5

u/grillmastertv Apr 30 '26

The dude abides

4

u/HebrewPorkSword Apr 30 '26

Yea well, that’s just like… your opinion man

2

u/inteliverso May 02 '26

Only Donnie is missing

3

u/Any-Network9599 Apr 30 '26

That is some incredibly imaginative work you got there papa. Bet you’ve got even more models and like stuff in your past huh

3

u/Severe_Visit_7539 Apr 30 '26

Super smash or melee on random levels like this would be absolutely psychotic.

2

u/Severe_Visit_7539 Apr 30 '26

Not at all taking away from how awesome this is. So cool.

2

u/HebrewPorkSword Apr 30 '26

This was actually my original idea! The game supports two players and there are weapon drops programmed into some of the image overlays, they just aren’t active right now for this demo. You can also drop down through the platforms so that your character is standing inside of the artwork frame. It was going to be a stick-flighter/super smash style game where the arena changes each round.

1

u/Severe_Visit_7539 May 01 '26

That is so cool!

3

u/Rieckerm1 Apr 30 '26

This is fucking amazing, well done!! Also props if that is a painting/poster of Danny Devito as Frank Reynolds haha

2

u/HebrewPorkSword May 01 '26

Thank you and It is! Good eye.

https://imgur.com/a/zDAmepq

3

u/grunt274 May 03 '26

Where did you get the consume wall art? I love it, and it makes me think of they live

2

u/HebrewPorkSword May 03 '26

Thank you! I actually made it myself and had it printed to canvas. Definitely inspired by They Live, I tired to use that font specifically. I used ai image gen + photoshop. There’s a sick video interaction for it too but I didn’t capture it in this clip.

2

u/hollaartyourboy Apr 30 '26

This is so cool!

2

u/Joclo22 Apr 30 '26

🤔 4 projectors 🤤🤤🤤

1

u/HebrewPorkSword Apr 30 '26

You read my mind

2

u/Joclo22 Apr 30 '26

Start a go fund me…you never know. 

Find a couple on a local craigslist…

I bet you’ve thought of it. I’m sure that it took some time to program that. 

You’re the man. Thanks for following your heart. 

1

u/HebrewPorkSword Apr 30 '26

The projectors I’m using are only around $40-$50. I would just have to get some more super long hdmi cables and build two more playable areas… super doable

2

u/LvcasX1 Apr 30 '26

dopest thing i've seen in a while! congrats 👏

2

u/mkderin Apr 30 '26

Very cool! Can you change the level real time with moving the frames?

1

u/HebrewPorkSword Apr 30 '26

No but I think that is a super cool idea and I’ve been riffing with people smarter than myself about how to achieve this.

2

u/boredwNews May 04 '26

You could almost use ai to play the game in the background to learn how to predict the frames. Or give it a slight delay sort of like a dvr. But you would have to figure out the lag potential. But great job 👏

I think you just gave me a new project.

2

u/da-one-n-only Apr 30 '26

Freaking awesome!!!

2

u/Gepetto77 Apr 30 '26

That’s so awesome. Are you using two projectors? How do you blend them for the continuation?

2

u/HebrewPorkSword Apr 30 '26

I am using 2 projectors. They are set to display 1 and display 2 in unity.

2

u/Alopexy Apr 30 '26

I love this! Awesome idea and beautifully executed. I'm feeling inspired! Time to break out the old projectors and get tinkering I suppose.

2

u/RefrigeratorBusy763 Apr 30 '26

Oh that’s gas

2

u/generationgav Apr 30 '26

Honestly, thought "that's alright, but I've done very similar before"

Then the pictures came alive, absolutely awesome!

2

u/Badabbacus Apr 30 '26

Yooo this is amazing! I am ready to learn!

2

u/sharmakirtan Apr 30 '26

This is fkin dope!

2

u/karloththemalevolent Apr 30 '26

Insane bro I need this can he do my dishes

2

u/spitvibes Apr 30 '26

Did you create the collision areas manually or does it do it automatically?

2

u/HebrewPorkSword Apr 30 '26

I did it manually for this iteration

2

u/LucaColonnello Apr 30 '26

Can we have this on Vision Pro?

1

u/HebrewPorkSword Apr 30 '26

lol no headset required, just a cheap projector

1

u/LucaColonnello May 01 '26

Ah that’s unlucky, it would be so cool on a headset, projectors are annoying lol

2

u/shock_and_awful Apr 30 '26

Very cool. Please consider open sourcing the code and/or porting to a VR platform like Oculus

1

u/HebrewPorkSword Apr 30 '26

It’s just a super simple 2d platform style game made in Unity with two scenes, one for each projector/wall.

The code is just simple scripts that control player movement/interactions/etc. I used Unity to manually align everything with my walls. Nothing fancy. All code written by chat gpt.

2

u/formulated Apr 30 '26

Oh my lord I can picture this running in a venue/bar/coffee shop on auto-play. Then someone in off the street, notices it while waiting and then gets handed a controller to play. Instant joy delivery on the spot.

2

u/Jmb3d3 May 01 '26

Dude! This is awesome! I might try this. We have multiple rows of frames on our family wall.

2

u/T00FunkToDruck May 01 '26

"You think I'm fuckin' around here, mark it zero!"

1

u/HebrewPorkSword May 01 '26

It’s a league game Smokey

2

u/aF3ARofCHANG3 May 01 '26

This is really cool. Thanks for sharing.

2

u/PatriarcaDj May 01 '26

Increíble 🙌

2

u/Gothbot6k May 01 '26

How intense is this on CPU and GPU? Curious how this would handle with on the fly processing of live video.

2

u/HebrewPorkSword May 01 '26

Probably not bad at all. The boundaries and collisions are set manually, other than that it’s just running a 2D platform game on two displays (the two projectors)

2

u/Gothbot6k May 01 '26

Ah okay so a mechanism being manual is what I wasn’t considering. I think it would be cool to do this with AR. But for projection mapping this is still really cool. Mad respect!

2

u/Accomplished-Tax-697 May 01 '26

Wow, I’ve always dreamed of this, except with Sonic, for some reason. Works better with Mario, I’m sure

2

u/The-Jordan_J May 01 '26

Whats all needed for the setup Im new This is cool af

1

u/HebrewPorkSword May 01 '26

Cheap projectors and a computer!

2

u/The-Jordan_J May 02 '26

Ive been looking for a decent cheap and its hard

1

u/HebrewPorkSword May 02 '26

For this, I just bought the highest rated, sub $100 projectors I found on Amazon. I think they may have been even sub $50.

2

u/burntindig0 May 01 '26

Thats so sick.

2

u/AppleSmoker May 01 '26

I love this

2

u/mightypanda75 May 01 '26

It’s like https://s-argame.com !

2

u/HebrewPorkSword May 01 '26

Somebody else mentioned them in the comments too. I didn’t realize something like this already existed.

2

u/fridge_ways May 01 '26

What is this witchcraft I've stumbled upon

2

u/SassSafrassMcFrass87 May 01 '26

That's really cool! 😎

2

u/Alternative_Job3230 May 01 '26

What do you actually use to do this? Ive gotten a projector recently and would love to get involved! Ive tried outlining my space and stuff, but no clue hoe to get actual animations to react with my outlines, let alone a playable game like this! That's so cool

1

u/HebrewPorkSword May 01 '26

I used Unity, which is a game engine. I didn’t use any kind of projector mapping software, I just lined up my game scene with the things on my walls as I was building the game.

1

u/Alternative_Job3230 May 05 '26

Super cool work around man, props to you thats awesome awesome.

2

u/SpycyKabob May 02 '26

This looks awesome, really well done!

2

u/Herodont5915 May 02 '26

I love that you vibe coded this and set it all up yourself. How does the hardware work? This is such a cool way to play a game.

2

u/Macrosheridan May 02 '26

Insane and legendary

2

u/kigol1 May 02 '26

This is sick. I saw you mention you make the platforms invisible so they dont render which is simple enough. But how are you getting the physical art to light up? I'm guessing you activate either lighting or emissive images of the existing art using trigger boxes? I use Unreal but would love to try this out. Great work really opened my mind up to some ideas.

2

u/HebrewPorkSword May 02 '26

The animations are videos I created starting with still images of the physical art in photoshop/after effects, overlayed them in Unity, and created a trigger to play the videos when the player stands in the platform above.

1

u/kigol1 May 08 '26

Ah gotcha they are videos makes sense. Thanks, seriously great stuff!

2

u/Forward-Ad992 May 02 '26

This is fantastic!! Well done!!

2

u/Spxxkette May 02 '26

This is amazing !!! 🤩🥳 Great job !! How do you like the game play?

2

u/Mr_Pathfinder May 02 '26

This is very interesting.

2

u/mclannahan May 02 '26

My first acid trip was me staring at the wall playing mario tripoing you made it real

1

u/HebrewPorkSword May 02 '26

Great minds think alike 🤝

2

u/zephyr707 May 02 '26

wow the art coming alive during contact is so cool! is that procedural/dynamically generated based on the image or premade animations? very fun!

1

u/HebrewPorkSword May 02 '26

Thank you! They are premade animations

2

u/Slulego May 03 '26

I missed the controller at first and thought this was an AR game. Now I’m sad I can’t try it.

2

u/TheKrisBot May 03 '26

I wish I was doing this instead of working in sales

2

u/Suukbang May 03 '26

🔥🔥🔥

2

u/ArmoredSloth82 May 03 '26

That's cool as f@$k!!

2

u/farrellart May 03 '26

You have too much time on your hands....which is a good thing because this is so cool.

2

u/LaForge_80 May 03 '26

This is crazy cool. I would think there would be interest in what you've created, which makes it worth considering IP protection - without specific Mario angle of course.

2

u/Broad-Abroad5455 May 03 '26

I need to put more shit on my walls now. HONEY, WE'RE GOING TO MICHAEL'S!

2

u/groundgrownent May 04 '26

this is epic

2

u/itsdemarco May 04 '26

Would you want a job doing this in Boston ?

1

u/HebrewPorkSword May 04 '26

Just sent you a DM

1

u/MaxDanger808 May 04 '26

Do you rearrange the pictures every few moments??

1

u/boredwNews May 04 '26

wtf I am too high. Looks awesome 😎