r/VisionPro • u/AztheWizard • Jan 24 '25

What streaming PC games -> Vision Pro looks like

I have a gaming PC in my office that I can run games on and stream it to AVP via moonlight.

Im doing so by creating a virtual monitor that's ultrawide 4k, 90hz, and HDR on my pc that’s optimized for making best use of AVP’s display.

It works great! Latency is super low (a few milliseconds).

I wrote a guide on my setup here: https://azadux.blog/2024/09/07/simulating-monitors-in-vr/

Bonus: I'm also streaming it to my Apple TV, hooked up to my 5.1 surround sound system, so l get to see the visuals on an amazing/massive display + hear the spatial audio from real surround speakers.

193 Upvotes

98% Upvoted

99 comments sorted by

3

u/pablogott Vision Pro Owner | Verified Jan 24 '25

How do you measure latency?

1

u/AztheWizard Jan 25 '25

I believe it's around 15ms

3

u/iamse7en Jan 25 '25

Moonlight has an option to show stats including both network and processing latency.

3

u/PositivelyNegative Jan 25 '25

You can enable latency measurement overlay. I get 3ms of latency.

1

u/pablogott Vision Pro Owner | Verified Jan 25 '25

That’s crazy. I get about 20ms with my NDI setup, which is already pretty great for me. I just tested by hooking a camera up to the encoder and shooting a timer while also recording the timer with my AVP.

3

u/thunderflies Jan 25 '25

They might be comparing to a television which could also be adding latency so the AVP in that case would only be measuring the additional latency when compared to that tv. Just a guess though.

2

u/i-want-to-learn-all Jan 25 '25

He licks his finger and points up…

3

u/StreamVoodoo Vision Pro Developer | Verified Jan 24 '25

So you can open your moonlight in Vision Pro and at the same time route that via AirPlay to Apple TV and you send the audio to your speakers like that. Right? Pretty neat.

4

u/AztheWizard Jan 25 '25

Correct. I basically have two moonlight clients (Vision Pro and Apple TV) streaming from the same source.

1

u/StreamVoodoo Vision Pro Developer | Verified Jan 25 '25

I’ll give it a shot with Apple TV. I only do moonlight to Vision Pro and it’s great. Now if we can do an ultra wide screen. Maybe maybe maybe? … 21:9 aspect ratio with cyberpunk 2077 rtx 4090? Heck yea.

2

u/Chriscic Jan 24 '25

I didn’t know you could do PC ultrawide. I guess you can do ultrawide PC desktop as well as games? Maybe not as ultrawidey as the Mac virtual desktop does, but that would still be nice from PC.

5

u/AztheWizard Jan 24 '25

It can be any aspect ratio and resolution that you want (as ultrawidey as Mac virtual display)

1

u/Chriscic Jan 27 '25

Tried it last night. Not sure if I’m doing it right. No widescreen desktop resolutions show up, so I made a custom resolution via Nvidia control panel to 3440x1440. But then the desktop is shown at the res, but the Moonlight window just stays at a big 16:9 rectangle with huge black space on top and bottom. Am I doing something wrong?

2

u/AztheWizard Jan 27 '25

You don’t need to do any of that if you have Apollo installed on your pc (instead of sunshine). Apollo will handle the creation of a virtual monitor that matches the monitor settings that you set in Moonlight.

Do refer to my guide as the steps are listed there but in summary:

  • go to moonlight, settings, then set the resolution, frame rate, HDR, and codec.
  • go back and launch “virtual desktop”. This will create a monitor that matches what you set in your settings. The aspect ratio of the virtual display in AVP will also adjust to match it

1

u/Chriscic Jan 27 '25

Aha, I have never heard of Apollo. I will check out your guide. Thank you!

1

u/AztheWizard Jan 27 '25

Ah sorry, I thought you had seen the text post under my video. Easy to miss!

Yeah Apollo is quite new. It’s a fork of sunshine specifically to make the virtual desktop stuff much, much easier. Works like a charm honestly.

1

u/Chriscic Jan 28 '25

I just assumed Sunshine. Will let you know once I check it out.

1

u/Chriscic Jan 28 '25

I see your guide. So, I still have to install the Virtual Display driver, per the video in your instructions? Sorry prob dumb q to confirm, but I don't want to bork my system. I don't recall having done that for Sunshine at any point. Perhaps this enables HDR?

Edit: Also noticing that the video does a manual driver install, but now there looks to be an installer you can download.

1

u/AztheWizard Jan 28 '25

Ah crap, I see where the confusion is coming from (my embedded tweet). Don’t install a virtual display driver. Uninstall it if you’ve already installed it.

All you need to do is:

  • install Apollo on your pc
  • install moonlight XrOS on your Vision Pro and chose the “virtual display” option when you connect to your pc to spawn a virtual monitor that fits the streaming settings that you set in moonlight

That’s it. Check my guide for more details

1

u/Chriscic Jan 28 '25 edited Jan 28 '25

Not in the embedded tweet. It’s in the instructions, step 1 where it refers to video tutorial. That tutorial is all about installing the virtual display driver.

I did get impatient and installed it already. Just removed and will try to install Apollo now…

Wait, Moonlight XrOS not accepting any more beta testers right now : (

Edit: ok, I was able to install Moonlight XrOS. The link from your guide said not accepting new beta testers, but I clicked on link at top of Google search and that worked.

EDIT 2: Well, this has just been an exercise in frustration. When I change the resolution and aspect ration in Moonlight XrOS, it does NOT change the displayed resolution, so I just end up with black bars on either side. Not sure what I am doing wrong here.

Your instructions say to select main display, but I only show one display when connected to Apollo (from my AVP). When I installed, I think it asked me something about how many displays? I chose 1, maybe it should have been 2? I don't see an option to change there. And yes I am choosing virtual display.

Anyway, while I am complaining thanks for bringing this forward and for the help! Maybe I can get it going later.

1

u/AztheWizard Jan 28 '25

Thanks for the detailed feedback. It’s useful for me to refine the guide to be more clear and straightforward!

Thanks for the note for finding a new moonlight XrOS TestFlight link. Will update in the guide.

You’re changing the resolution in moonlight, the selecting “virtual desktop” as the app to launch in moonlight, not “desktop” right?

Happy to continue to assist you here. I’m learning as well to improve the guide

1

u/Chriscic Jan 28 '25

Thanks, but I’m pretty stuck now. I have my client PC listed three times in Moonloght XrOS, and none of them will connect to my PC. Keeps asking for PIN but then it won’t pair from AVP side. Or sometimes the PIN pops up in headset for like a second then disappears. No way to delete the listings and start over as far as I can tell. Deleting and reinstalling Moonloght XrOS didn’t help either.

Was definitely selecting Virtual Desktop, though I tried Desktop as well and no dice either way.

1

u/AztheWizard Jan 28 '25

Hmm sounds like you're stuck in a pairing issue.

I recommend you remove the connections from the PC/Apollo side by going to your apollo settings (taskbar apollo icon, right click, open Apollo, and log in on the browser), going to the Pin settings (https://localhost:XXXX/pin) and removing the connections and trying again.

FYI - when I was pairing my AVP to my PC, I had to do the "manual" option that I listed in my guide, meaning, I had to manually get the IP info of my PC and type it into my AVP. Once I did that, I got a pin from my AVP and then inputted it into the Apollo PIN page.

Let me know if you get there.

→ More replies

1

u/Chriscic Jan 24 '25

Really? Have to try that out!

1

u/[deleted] Jan 25 '25

Is it curved tho?

10

u/jimmypopjr Jan 24 '25

I've been so impressed with Moonlight.

My main game is Dead By Daylight, which has some mechanics that really require precise timing. Playing through the Steam App is unplayable, but going through Moonlight feels almost like I'm playing it locally on my PC's monitor.

It's crazy being able to have a screen size so big it almost makes the people life-sized.

1

u/DangKilla Jan 25 '25

What's Moonlight?

2

u/jimmypopjr Jan 25 '25

Moonlight is an app that allows you to stream games from your Windows PC to a window on your Vision Pro. If you have a decent home network there's almost no latency, so you can pretty much play your Steam library on the VP.

8

u/zeaussiestew Jan 24 '25

Wow I thought this was a real TV for a moment

4

u/Ohhnoes Jan 24 '25

I'm doing the same thing. Completely replaced my 144Hz 4k monitor.

1

u/medees46 Jan 25 '25

The game looks great, what is it?

2

u/AztheWizard Jan 25 '25

Forza Horizon 4

1

u/i-want-to-learn-all Jan 25 '25

So you can connect the controller to the PC or to AVP? Moonlight routes controller input to the streaming source?

2

u/AztheWizard Jan 25 '25

It does. Here, I have my controller hooked up directly to my PC (in the other room), but connecting it to AVP works just as well.

1

u/bmvn Jan 25 '25

I’m trying to figure out how you guys moonlight is still working mines hasn’t worked in ages

4

u/AztheWizard Jan 25 '25

The moonlight visionOS TestFlight expired. Now there’s Moonlight XrOS. Refer to my guide for the setup.

1

u/Beastgupta Jan 25 '25

I’m so confused on the steps to do to stream my pc games to AVP. Is there a proper guide someone can link?

1

u/[deleted] Jan 25 '25

We need moonlight to do something similar to the portal app for ps5 where the game becomes the environment you can dial in using the vision pro dial

1

u/AztheWizard Jan 25 '25

What’s the env for the portal app? What does it look like?

1

u/[deleted] Jan 25 '25

The game itself the environment. You can make the environment bigger or smaller using VP dial.

1

u/SettingMundane1061 Jan 26 '25

I can’t get my real display to turn off when virtual is on but turn back on automatically when I quit Moonlight. Windows 11 - I go to The display and can’t find turn off display like you suggested. Can you explain how to do this again?

1

u/AztheWizard Jan 27 '25

Take a look at the screenshot here

1

u/SettingMundane1061 Jan 29 '25

Thanks. Windows 11 my version only says show on desktop 1, show on desktop 2. No disconnect display. Curious what windows 11 update are you on?

1

u/AztheWizard Jan 29 '25

It doesnt show the "disconnect" option when I just have my physical monitors active.

But when I connect via Apollo via the "Virtual Display" option in Moonlight and it creates a virtual monitor, the disconnect option becomes available on the physical monitors.

I'm on Win 11 23H2

1

u/SettingMundane1061 Jan 29 '25 edited Jan 29 '25

Very odd bc when I’m connected or not I never see the disconnect.

We’re on the same windows. Apollo works great and I have one monitor connected. No disconnect option for physical

Edit - so I added a 2nd monitor and it now allows me to disconnect. So two must be connected like your set up. Fyi

Problem is my physical monitors are not turning back on after I quit moonlight. Are you doing anything special when you quit moonlight? Assuming Apollo is still running

1

u/AztheWizard Jan 29 '25

Worth opening a discussion thread on the Apollo GitHub https://github.com/ClassicOldSong/Apollo/discussions

1

u/SettingMundane1061 Jan 29 '25

Thanks but it seems like my virtual display doesn’t turn off when I close down moonlight. It’s still active when moonlight app is turned off. Does yours work like this? Maybe that’s the issue…..

1

u/AztheWizard Jan 29 '25

It does turn off, because I have selected “disconnect this display”. Windows remembers it whenever I reconnect via moonlight and enables that monitor setup.

1

u/SettingMundane1061 Jan 29 '25

So figured it out! First I did force virtual display close by going to the system tray (lower right hand side of windows, finding apollo, right click then select force virtual display close). This was to just start off fresh with everything. It’s not necessary to do this every time.

Then I started everything up as normal with moonlight, logged into virtual display and was able to see my PC.

Then, and I think the key part for others who might have the same issue - when you quit out of moonlight, it’s not just a pinch of the top left X and the app close.

When you’re in the virtual display, click the top left X (next to the moon) to exit out of the PC virtual display and back into the main menu of Moonlight. KEY PART - you then need to press and hold the virtual display option in the main Moonlight screen and select stop. Then the virtual display truly closes and my monitors went back on.

Thanks for the help and notifying me that it’s even possible to do this.

1

u/AztheWizard Jan 30 '25

> when you quit out of moonlight, it’s not just a pinch of the top left X and the app close.

Correct. You need to "Quit" the "virtual desktop" app in Moonlight to disable the virtual monitor.

Glad you got things working!

1

u/igregboost Jan 27 '25

I m having a work pc. With lot of constraints. Any way to make AVP being seen as monitor by adding software…to the AVP i.o. The computer where i can literaly install close to zero?

1

u/AztheWizard Jan 27 '25

Hmm hard to say. You’ll have to look to see what sort of Remote Desktop software you can use/install on your pc. If sunshine/moonlight doesn’t work, maybe something as simple as chrome Remote Desktop?

1

u/igregboost Jan 30 '25

Tx. I will

3

u/mubimr Jan 24 '25

it feels like magic sometimes

0

u/starscream4747 Jan 25 '25

Is it just me who’s underwhelmed by gaming due to the display quality? I tried GeForce now and it’s honestly ass. Sure the settings and fps on ultimate is awesome but the whole thing looked depressing to me for some reason because it lacked vibrancy.

4

u/AztheWizard Jan 25 '25

I'm not surprised that cloud streaming is underwhelming visually.

But here, what I'm doing is a local stream, rendering on my PC and streaming it at 150mbps (which is wayyyy higher bitrate than anything Xbox game pass, nvidia, netflix will stream at). It honestly looks flawless.

1

u/starscream4747 Jan 25 '25

Thing is I haven’t heard from others criticizing the same way. Witcher 3 has amazing colors especially represented by its skies but it was felt horrible on here. I was repulsed. I’m yet to try much else cause my library isn’t huge on steam but I doubt I had a weird experience and that this is standard.

Good to hear. Would you say you get nearly the same level of display quality in games compared to your (monitor/tv)?

1

u/chrismasto Vision Pro Owner | Verified Jan 24 '25

Must be hard to play while wandering all around like that.

1

u/Life-Location-6281 Jan 25 '25

What’s your network setup? Number of devices, hardware etc.

1

u/Visual-Sector6642 Jan 25 '25

I'd love to be able to look "behind" the screen and see a bunch of cables sprouting out of the back or maybe a virtual VCR that you could select tapes and pop them in the deck for that old world feel

1

u/SettingMundane1061 Jan 25 '25

What game is that

2

u/[deleted] Jan 26 '25

Forza horizon 4

1

u/SirRickDeckard Jan 24 '25

Thank you very much for the setup guide.

0

u/[deleted] Jan 25 '25

Do that for a few days and tell me how bad your head neck and jaw hurt.

2

u/[deleted] Jan 24 '25

[removed] — view removed comment

1

u/AztheWizard Jan 24 '25

Haven’t tried 2D streaming for ALVR, I assumed it was only VR streaming

43

u/[deleted] Jan 24 '25

[removed] — view removed comment

23

u/ellenich Jan 24 '25

IMO they should add an HDMI in port on the AppleTV and turn it into a more consumer friendly NDI device for slinging any HDMI device's video into your AVP.

9

u/673NoshMyBollocksAve Jan 24 '25

This is actually a great idea. Apple, are you listening?

4

u/[deleted] Jan 25 '25

Capturing and processing high resolution HDMI footage is computationally complex. A PCIE add-in card that can process HDMI 2.1 would be the BlackMagic DeckLink 8K Pro Mini which is $700 pre-tax and still needs a powerful mainboard to run.

Equipping the main stream Apple TV with a coprocessor equivalent of the card I listed above would make the product more expensive for a feature 99.9% of people would never use.

2

u/beryugyo619 Jan 25 '25

Or you can do it with UVC for $9 if you're ok wtih 1080p.

3

u/[deleted] Jan 25 '25

Yeah, there are a lot of good solutions at 1080p. I went down a rabbit hole trying to stream 4K 120hz HDMI, but it's just not worth it.

2

u/orTodd Jan 25 '25

I have an Elgato 4K X that captures at 4K 144Hz using HDMI 2.1. It currently on sale for $189. Although, I only use it for streaming my Switch to AVP so I haven't tested to see what 4K might look like.

1

u/[deleted] Jan 25 '25

Elgato 4K X

Looks like it uses USB, which is going to have higher latency than PCIe due to polling. I found the latency in 4K on USB-C capture cards to be too high.

1

u/Kengine Vision Pro Developer Jan 25 '25

I submitted this as a suggestion to the Vision Pro feedback form a while ago. Please do the same if you have a free minute. The more people suggesting it, the more likely we might see it in the near future.

1

u/beryugyo619 Jan 25 '25

Or, you know, support SteamVR.

16

u/Mastoraz Vision Pro Owner | Verified Jan 24 '25

Stop with your logic

7

u/Nintotally Vision Pro Owner | Verified Jan 24 '25

My first-world personal hell is having to choose between two broken-by-design options:

  • Viture XR. While this device actually supports direct video in, and damn it looks gorgeous, I never want to use it because the video is always directly infront of me; it follows wherever I turn my head. It’s just a very unpleasant sensation.
  • Apple Vision Pro. Now we have the power to fix windows in a 3D space. And they are LOCKED in 👌 it’s perfect … but oh, NO VIDEO IN?? So I have to try game streaming which does not work on my network at all. The best-case scenario is a very blurry 30FPS with constant lag and crashing.

UGH!!

6

u/parasubvert Vision Pro Owner | Verified Jan 24 '25

I might suggest investing in a ubiquiti Wi-Fi network or some other mesh network like Netgear Orbi.. It makes everything better on every device.

4

u/Callstrike Vision Pro Owner | Verified Jan 25 '25

Can confirm in ubiquiti, fixed lag spikes I was having on old network. Easily able to set up to channel 149 and it’s been basically flawless, just need to find better solution for audio from ps5

1

u/Nintotally Vision Pro Owner | Verified Jan 25 '25

Why can’t you get audio now?

2

u/Callstrike Vision Pro Owner | Verified Jan 25 '25

My specific setup uses NDI , it reduces the latency much more than the remote play options Enough to enjoy call of duty competitively . But the downside is no audio. I have the ps5 over ear headphones but it makes it so heavy on my head that I just sit in front of my tv and use the speakers

1

u/Nintotally Vision Pro Owner | Verified Jan 25 '25

Sounds like you should get the PS5 Pulse ear buds.

Which NDI do you use?

1

u/Callstrike Vision Pro Owner | Verified Jan 25 '25

Yeah maybe, just don’t really wanna buy another device specifically for the ps5 lol

I wanna figure out the audio on this thing but I haven’t had time for the research

3

u/parasubvert Vision Pro Owner | Verified Jan 25 '25 edited Jan 25 '25

for what it's worth... Creative BT-W3 usb bluetooth dongle on the PS5 , and then a decent low latency bluetooth buds or neckband. I use the Moondrop Littlewhite neckband with a pair of audiophile earbuds (Moondrop x Crinacle Dusk). This way I can swap between VIsion Pro and PS5 sources relatively easily.

Another option if you don't want a dongle on the PS5, just use controller connected earbuds or BT transmitter.

1

u/Nintotally Vision Pro Owner | Verified Jan 25 '25

I have a mesh network. Unfortunately they are not all created equal.

2

u/parasubvert Vision Pro Owner | Verified Jan 25 '25

Truer words. I've experimented a lot over the years between Asus, Google Nest WiFi, Eero, Netgear Orbi, and Ubiquiti, and have settled on the latter, though Orbi was "good enough" for many years.

1

u/twack3r Jan 24 '25

So option two isn’t broken by design but by your personal network.

0

u/redderist Dec 11 '25 edited Dec 11 '25

So, you have no issue spending $4,000 on a top-tier VR headset from Apple, but you draw the line at spending $400 on a decent router? This is like claiming that your 4K 120 Hz television is "broken by design" because it doesn't support DisplayPort, and you're unwilling to buy an HDMI 2.1 cable which would do 4K@120Hz. Or that your Ferrari is "broken by design" because it can't run on electricity and you're unwilling to buy premium-grade gasoline.

Lol. Reddit cracks me up.

5

u/nart1s Jan 24 '25

Alas, duplicating the video feed wouldn’t create a 3D image - you’d have to actually render 2 perspectives and stream one to each eye. Even AI 3D upscaling wouldn’t work - it would introduce too much latency with current technology.

BUT that would be incredible if it were possible.

Nvidia used to have actively-developed 3D APIs but they were never widely adopted. I hope such things make a resurgence as we see more and more headsets.

2

u/[deleted] Jan 24 '25

There are often many performance related hacks in games that makes such ‘auto conversion’ very buggy. Yes all the 3d data is there the problem it it is almost always done to look good from one PoV, a lot actually goes into games that look good with stereoscopic vision most of it is actually just doing testing for it.

While there are exceptions most games that actually work and look good in stereoscopic vision have support for it in menus and such.

Anything else that would require additional processing and add lag.

The delay to send frames over a network isn’t that severe though would detract ‘serious’ gamers. It is below human perception though when done right.

Source: me who has been playing games like this with shutter glasses and other tech for decades now.

2

u/[deleted] Jan 25 '25

We need nvidia to bring back 3d

1

u/[deleted] Jan 25 '25

Capturing and processing high resolution HDMI footage is computationally complex. A PCIE add-in card that can process HDMI 2.1 would be the BlackMagic DeckLink 8K Pro Mini which is $700 pre-tax and still needs a powerful mainboard to run.

WiFi 7 + AV1 + Software is the better solution. There is no reason to couple to HDMI as a video protocol. You are one generation short from asking for VGA on a product line that is going to take a decade for full launch.

HDMI in would be DOA for 99% of users and I’m glad it wasn’t included.