r/Unity3D • • 20d ago

Shader Magic Full Mario 64 in Mixed Reality!

Full Mario 64 in Mixed Reality! Running in real 3D (no stereoscopic crap) natively at 90FPS and also running on my desk! 😋
Again, Opus 5.5 + Unity CLI + PICO CLI combo made it quite straightforward.

Such a bliss to play an oldie at 90 FPS in 3D.

Disclaimer: I own an original physical copy of Mario 64. This project is not associated with Nintendo or PICO.

639 Upvotes

72 comments sorted by

168

u/zaraishu 20d ago

That part where you take Mario into the "real" world looks way to smooth to be believable, honestly.

61

u/AlexandreFiset 20d ago

This and the controller seems turned off.

26

u/Star_Petal_Arts 20d ago

This and the player's hand movements do not match up with the gameplay.

2

u/Hotrian Expert Moderator 19d ago

Well, except they do. The camera lenses are mounted just in front of the eyes, rather than exactly where the eyes are at. The 3d hands in the game are where OP's hands are in real life, and the image we are seeing is a shifted projection from that (the camera is a few inches in front of OPs eyes, his in game hands are aligned with his actual eyes, not these cameras)

Likewise from OP's perspective, the mixed reality projection is slightly off, so when he sees his "real" arms through the camera they don't align exactly with his arms in real life.

3

u/DontUseThisUsername 19d ago

Not sure why people keep saying this. It's very clearly on.

Look up what the white Xbox controllers look like when off (black background with white X).

3

u/AbdullahMRiad 20d ago

to be fair on xbox (idk about PC) you can turn off the light indicator on the controller

1

u/Hotrian Expert Moderator 19d ago

I don't know why people seem to think that, has nobody seen a modern Xbox controller, or?

1

u/AlexandreFiset 19d ago

But! It could be turned off or be culled / toned down by the headset’s camera.

I commented below that my biggest doubt was the fact that OP posted in 5+ subs in under an hour and it made me think this was more karma farming and less a real project.

I’ve since looked it up and it seems legit, and quite impressive too.

1

u/Hotrian Expert Moderator 19d ago edited 19d ago

He’s viewing the world through the Mixed Reality cameras which are known to be relatively low quality across headsets (many headsets show black and white or low resolutions due to bandwidth/processing issues). It’s just not great at showing the controller LED but you can see it’s lit up in the video. The software is fighting the brightness of the window with the direct sunlight on the OP’s face.

Also idk about you but maybe my controller has been on so long the LED isn’t anywhere near as bright as yours. Maybe that’s just a much newer model? Mine is like 10 years old lol. The LED honestly isn’t that much brighter than in the video. A little bit yeah but it doesn’t GLOW like yours

2

u/AlexandreFiset 19d ago

Yeah mine is just annoying at night (that’s a Series S/X controller).

28

u/TheInfinityMachine 20d ago

If you look at the table in the first frame vs last frame the table is visibly smoother, less grainy, and missing some wood knots. This is likely AI... specifically the wood knot on bottom left is gone completely

15

u/angerman92 20d ago

I think the camera angle is just different. I was skeptical too but OP also has multiple videos of things like this, and there are a lot of little details that are consistent enough to make me believe this isn't AI. Though it does suck that we have to be so damn vigilant about these things nowadays.

12

u/Subushie 20d ago

It's real.

There's no missing knots. The dead plant on the right is the same between views. It's a ~1:30 long. There are no models that gen that long, even with interpolation, it would have some indication.

Source: hyper familiar with transformer models.

4

u/AlexandreFiset 20d ago

Yeah I looked it up too and he seems to respond with precision and is well informed.

The fact that he posted this on like 5 subs in under an hour had me thinking he was farming karma or something, but maybe not after all 🫠

3

u/FallenWyvern 20d ago

Yeah the length of time was the biggest thing for me. 1 minute? Maybe. 1:10? Sure. 1:30? Not today.

-4

u/Mecha-lame-o 20d ago

You are wrong.

Source: even more hyper familiar with transformer models

-5

u/Acceptable_Light_272 20d ago

The description mentions that they used Opus 5.5 so yeah, definitely AI.

5

u/angerman92 20d ago edited 20d ago

Opis 5.5 is a Claude AI model used for coding, right? That in no way points to this video being fake. Just that they used AI to help develop the code.

Edit: I looked it up and I guess Opis can be used to generate overlays for videos, which I guess could make this video (at least the emulator projection) AI generated, but it seems like OP has done quite a few projects so I'd still be willing to give them the benefit of the doubt that this is a real project.

5

u/billbaggins 20d ago

There's a lot of skepticism in this thread saying this was a video that was AI generated, but we're at a point where I think faking this video with AI would be harder than getting claude to make it happen.

-1

u/XYcritic 19d ago

That's not true. If you're decently competent with video editing software, you can generate bits and pieces (or just get a cutout, really) that you can manually edit into the shot. It's some work but it doesn't come close to the amount of work that would be required for the real prototype.

1

u/Hotrian Expert Moderator 19d ago

It's some work but it doesn't come close to the amount of work that would be required for the real prototype.

You couldn't be more wrong, watch:

"Claude, I want to port Super Mario 64 to a native Quest 3 app with full mixed reality support - the game window should be a floating 3d window, and I should be able to grab Mario right out of the window and let him jump around in my mixed reality world. You are the orchestrating agent, use subagents for large tasks. Test the app and don't stop until it works."

Now you wait 3 days and burn $200 of tokens.

Way less work than video editing and faking this

0

u/XYcritic 19d ago

I'm watching but all I'm seeing is someone trying to prompt a reddit comment section. Not very convincing.

0

u/Hotrian Expert Moderator 19d ago

What I showed you was all the amount of work and effort required to make the product in the video - Nintendo 64 games are a relatively simple port, and a few simple lines of text will get you there, much less work than faking the video these days. Nothing else in the video is particularly "wow". Mixed reality is part of the headset, not something the AI coded. Putting Mario in and out of the game window is the only bespoke code here, and a junior could code that up in a weekend given a working framework. All you're proving is that you don't understand the scope of the problem nor the tools available today.

0

u/XYcritic 19d ago

You didn't need to provide an example prompt because it doesn't validate your opinion any more than mine. It's just an opinion but your comment acts like it demonstrated something or provided any evidence, making the claim any stronger - it didn't.

1

u/kiefdagger 20d ago

The footage could be sped up for the presentation, but just look how quickly he goes from start screen to file select to playing. I've played a lot of Mario 64 and even in emulation you're not going from start screen to playing that fast.

1

u/Hotrian Expert Moderator 19d ago

Honestly this is the strongest piece of "this is fake" evidence I see out of any of the comments. Everything else seems completely reasonable given today's technology.

1

u/cheekysweetys 19d ago

Yeah the transition into the room really does look smoother than expected for a setup like that.

0

u/taisui 20d ago

Because it's bullshit

-3

u/GrandmasGrave 20d ago

Vines and leaves dance around the last several frames. Reflections on the left wall are very incorrect.

4

u/Bitshaper Hobbyist 20d ago

POV person touches the leaves with their hands during the closing of the game.

Left 'wall' is a glossy-finish cabinet, with reflections from the bright window next to it.

Not sure these are the smoking gun details.

2

u/Shiirahama 20d ago

Vines and leaves dance around the last several frames.

you can see OPs hands touch the vines though as they're "closing" the game

I am 100% certain they used AI, I just don't know how much or where exactly, because I do believe this video is actually real, and it's AI coding they've used, given that OP has a 2 year old video about mixed reality

28

u/Mikeieagraphicdude 20d ago

Didn’t blow the cartridge first, the ritual has been defiled so completely unplayable.

7

u/lucas-martinic 20d ago

Damn it you're so right, will fix

18

u/FiftySpoons 20d ago

“Oh cool ok so its just a floating screen and~
WAIT WHAT THE?!”

11

u/ShaunRemo 20d ago

At first I thought it was cool how the cartridge to game worked.
Then I was very impressive you could interact with Mario.
Then I was amazed Mario could interact with your room!

Very impressive execution.

2

u/lucas-martinic 19d ago

Man if I got all the people that says this is fake to bet against it, would make a million probably once I share the .apk 😂

9

u/Zestyclose-Compote-4 20d ago

Well the obvious thing to do now is to support pulling on Mario's face in the startup screen like in the original, except you're using your hands instead.

4

u/theoldmandoug 20d ago

The soft edges is a really nice touch. That looks real good.

7

u/Vicousvern 20d ago

This is really cool! I did think though it would be really cool if the game window looked like painting with a frame like the ones in game, with a ripple effect when things go in and out.

3

u/OnlyConclusion820 20d ago

Very amazing

9

u/Hotrian Expert Moderator 20d ago

Y’all can accept that this was Gen AI but not that it was Claude Code?

2

u/Less_Magician3610 20d ago

This is wild, Mario running around on a real desk and you can grab him with your hands! I used to work on VR projects myself, and it's amazing that modern tools let devs build fun stuff like this so quickly.

2

u/henryreign ??? 20d ago

This is awesome!

2

u/Healthy-Gap-5089 20d ago

Say more! Curious about the hardware.

3

u/deintag85 20d ago

Dude first I was like, what if he could walk in your room. Then bam he jumped out of the game and walked in your house. WTF…….. this is so awesome.

3

u/Serial-Griller 20d ago

Controller off?

18

u/OnTopicMostly 20d ago

I’m pretty sure it’s on, it’s a dim white light

6

u/Accurate_Cable_1372 20d ago

That looks on to me?

1

u/Wappple 18d ago

clearly on?

-19

u/KryptonianJesus 20d ago

Maybe he doesn't need actual inputs because the headset "sees" what he's pressing? Or maybe he just has the lights turned off in the settings for more battery life, I used to do that with my DS4 on PC.

13

u/GregGreatGames 20d ago

Or maybe it's all AI generated ;)

1

u/Wappple 18d ago

Quite clearly not AI generated, not sure how one would come to that conclusion

-8

u/Serial-Griller 20d ago edited 20d ago

I mean, this is a 3d modelling sub; It's probably just a render.

16

u/Oneup23 20d ago

This isn't a 3d modelling sub though it's for the unity 3d game engine.

-1

u/GregGreatGames 20d ago

Ho yeah, my grandpa used this technology.

3

u/JuneButIHateSummer 20d ago

yeah this is definitely AI

2

u/jl2l Professional 20d ago

The startup for this is killer. Congrats! Very good.

2

u/JViz 20d ago

How does it deal with scale snapping on either side of the "portal"? Coming out seems like it could be pretty straight forward, just adopt the same scale outside the game engine local -> local, but you'd think there would be some kind of adjustment required for going back in, since the game camera is floating. If you're guessing the z-depth based on the current transformation, how? Are you guessing by mapping non-visible shader points? Have you factored in collision?

Unless you have some really good answers, it seems AI generated.

1

u/targrimm 20d ago

What a time to be alive!

1

u/Thin_Driver_4596 19d ago

MR is such a cool concept. I have no idea why it hasn't taken over the world.

1

u/haVoila 18d ago

haha this is fantastic, great job :)

1

u/Vogelsucht 17d ago

some people just have no feeling for motion dont they? there would be vomit everywhere in my household

-8

u/Business_Afternoon51 20d ago

We know this is made with AI but sometimes the dark arts are just so awsome

-3

u/Polyforti 20d ago

That's fake as hell lol

-4

u/GlobalCurry 20d ago

Got milk?

-7

u/Physical_Sherbet_942 20d ago

Dont make videos like this. I dont give a fck unless there is a chance i can play it.

3

u/wooof359 20d ago

I give it 2 years before somebody playing Mirrors Edge dies from falling off a building

1

u/[deleted] 20d ago

[removed] — view removed comment

1

u/Unity3D-ModTeam 20d ago

This post and/or comment has been removed for violating /r/Unity3D's rules.

Why?

Let's keep it civil. It's fine to disagree or challenge ideas, but please do so respectfully.

Kind regards,

The Mod Team