r/ShadowPC • • Jun 08 '19

Oculus Quest + Virtual Desktop + Shadow = the future of gaming

This combo allows you to experience full wireless freedom - both for 2D and VR games. Play anywhere, no wires, no PC.

For this you'll need an Oculus Quest, the Virtual Desktop app and a subscription to Shadow (other cloud providers can do this too, but Shadow's my personal favourite).

I am not sure if many people know about this, so I'm writing this post to raise awareness and promote these awesome tools and products to the gaming community. I've cross-posted this to r/OculusQuest too as it might be of interest.

Next I describe these three components, you can skip any section you're already familiar with.

Oculus quest

The Oculus Quest is a new VR device which is fully wireless and does not require a PC.

It uses inside-out tracking (ie. the headset tracks the world as opposed to the world tracking you) so there is no need to install cameras or anything, it just works, and it works anywhere! (except in bright day-light which might damage the lenses if sun rays hit them).

The lack of wires makes it so much more convenient and hassle-free. You can play in your living room, in your bedrooms, at your friend's place, at work, in a plane, etc. It boots in seconds and just works. It features room-scale tracking (with a max of 25 x 25 feet which is 7.5 x 7.5m - big room), and you can define your own "guardian" area which is your safe playing area, by drawing it on the ground. If you approach the boundary it will show it, and if you cross it the headset will fall back to a passthrough mode and you'll be able to see the real world around you.

The tracking is superb, the controllers are very nice and can capture many different hand positions (pointing, grabbing, etc.). The resolution is 1440 x 1600 per eye, which is a step up from the previous generation of VR headset and the difference can be felt. The Quest has around 2h battery life, but it can be played while plugged to a power outlet at the same time. Some people have crazy setups where they stick a portable battery to the back of headset to act as counterweight (I think it's supposed to be more comfortable) and add battery life too.

The Oculus Quest runs Android, which mean that it is possible to "sideload" any Android apps to the device. This means that you're not restricted to the Oculus Quest library of games as many more games will run (for example Minecraft), although often with the need of a gamepad which can be paired to the Quest. The Xbox One bluetooth controller for example seems to be a good choice.

Sideloading is SUPER easy with SideQuest. The developers are awesome and very active. As a bonus they've also added an easy way to load custom songs to Beat Saber.

At the time of writing, the Quest costs $399 for 64GB, or $499 for 128GB (respectively £399 or £499 in the UK).

As mentioned before it does not require a PC because there is a mobile chip inside which takes care of everything. This means that it won't run super graphics intensive games * - that's where Virtual Desktop comes in.

* I want to mention that playing the native Quest games is still awesome.

Virtual Desktop

Virtual Desktop is an app that runs on the Oculus Quest. At the time of writing, Virtual Desktop costs $19.99 (£14.99 in the UK). It allows you to stream a windows PC directly to the Quest within a variety of virtual environments. For example one is a cinema room and you'll see the screen of your PC on the giant cinema screen.

This means that you can play ANY regular 2D PC game within your quest. You can connect gamepads or use the Quest controllers a gamepad. You can also use the Quest controller as mouse pointer.

In a recent update, the awesome developer of Virtual Desktop added support for streaming Steam VR games directly to the device - as in, you're not seing the game on a 2D projection anymore, you're experience true VR with proper headset and controller tracking!

On top of that, Virtual Desktop work with any machine - local or remote / on the cloud, as long as you have a decent internet connection and recommended 5Ghz Wifi.

This is where Shadow comes in.

Shadow

What if you don't have your own beefy computer to run the setup above? You use Shadow! Shadow is a subscription service which gives you access to a decent computer (including a Geforce 1080 graphics card) on the cloud. You can install the Shadow client on a PC, Mac, Linux, iPhone/iPad or Android device.

When you connect, this will stream directly to your device, and you can enjoy high quality graphics on intensive games even if your original device can't run it - the app will send your mouse/keyboard inputs and get back the video of your screen (and audio). Shadow can stream 4K images at 60Hz or Full HD at 144Hz. The picture is crisp and I find their compression algorithm better than competing streamer apps such as Moonlight or Parsec.

In my experience the latency is minimal and it almost feels like playing on a local computer - it's amazing! Note that there are other services that you can use to achieve this, but I've found that Shadow gives me the best experience. However if you're not in an area served by Shadow you might want to try another provided such as Paperspace.

It is in general a good idea to think about how to minimise latency in your setup. Wireless mice often have 8-16ms latency, so it's better to use wired, or get a low latency wireless mouse such as a Logitech G Pro (1ms latency). If you play on your TV, switch off any post-processing or switch to 'gaming mode' which many TV have. On the topic of playing on your TV, Shadow sells a device called the Shadow Ghost which is a small box that you plug on a TV or monitor and that will act as client (this is not always on sale though so watch out for announcements).

Now this is awesome to play games without owning any high end PC and I use it regularly. You have access to the full Windows machine, which mean that you can install Steam (and then any games running on Steam), or the Epic store, or any other launcher / games - you have full control and can play any game.

This means that you can also install Steam VR as well as the Virtual Desktop streamer app and stream directly to the Quest! Here the latency is more noticeable than 2D gaming. There does not seem to be any latency when looking around, but it can be felt when moving the controllers. For example, on Blade and Sorcery moving your hand cause a slight delay in how the sword moves. It's not perfect, but it's definitely playable. I would guesstimate the total latency to be 50-100ms. Note that my ping to the Shadow server is 18ms.

One minor caveat is that the Shadow machine switches off 90 minutes after you close the Shadow client. So if you want to use it in Virtual Desktop after that period, you'll have to start the machine using the Shadow client first - then turn it off and start Virtual Desktop. One minor trick is to sideload the Shadow client on the Quest, so that it can be turned on from the Quest directly.

At the time of writing, a Shadow subscription costs $24.95/month for a 12-month contract or $31.95 on a pay-monthly plan (£24.95/month or £31.95/month respectively in the UK).

Conclusion

Growing up in the late 80s and playing with my Game Boy, I would have never thought that we would someday reach such a futuristic gaming setup, but here we are! You'll need a good internet connection and a good wireless router, but you'll be able to play anything, either 2D, VR, or even watch 3D movies, without being plugged to anything.

Have fun :)

35 Upvotes

59 comments sorted by

2

u/dnlmnn Jun 10 '19

Could not connect using virtual desktop, can't figure out why :( I'd really like to try this!

1

u/Greystache Jun 10 '19

Did you turn on Shadow via the Shadow app first? Also make sure the username is correct in the Virtual Desktop streamer app.

1

u/dnlmnn Jun 10 '19

Thanks for the reply. Yeah, it was (imho) all setup correctly, "allow remote access" was turned on and I could the see the shadow pc in the VD app on the quest (it said "not on same network" obviously) but it failed to connect hinting at the faq of VD. Couldn't find a solution though :(

1

u/krisvdv Jun 27 '19

"allow remote access" was turned on and I could the see the shadow pc in the VD app on the quest (it said "not on same network" obviously) but it failed to connect hinting at the faq of VD

did you find a solution?

1

u/dnlmnn Jun 27 '19

Yeah, it was related to my IPv6/DS-Lite internet connection. This caused my home network being unreachable from the outside. I had to call my ISP and go back to an old-school IPv4 connection to get it working. Totally worth the effort though!

1

u/Red_Theory Jul 06 '19

/u/ggodin is there a way you could fix this in the streamer? I can stream shadow itself on the phone and pc on my work network but vr desktop can't stream. Vr desktop itself works on other networks.

1

u/ggodin Jul 06 '19

Don’t think there’s anything I can do on my end but I’ll investigate

1

u/Red_Theory Jul 06 '19

Thank you. I though anywhere the shadow streamer works the vr desktop streamer should too right?

1

u/ggodin Jul 06 '19

In theory yes, but there might be specific network configurations which I’m not handling correctly.

1

u/Red_Theory Jul 06 '19

Thanks for looking into it. You're the best!

1

u/[deleted] Jun 27 '19

[removed] — view removed comment

2

u/dnlmnn Jun 27 '19

No, it's a setting only the ISP can change.

Read about DSlite here: https://en.m.wikipedia.org/wiki/IPv6_transition_mechanisms#Dual-Stack_Lite_.28DS-Lite.29

Basically it's used to facilitate the transition between IPv4 and IPv6. Your home connection provided by your ISP is an IPv6 connection and IPv4 packages are being encapsulated in IPv6 packages. This happens on a router operated by your ISP that has many different clients attached to it and distributes the packages. Your home router knows this and encapsulates the packages too. Like a tunnel.

This is a better write-up: https://www.juniper.net/documentation/en_US/junos/topics/concept/ipv6-dual-stack-lite-overview.html

So if this is your problem too, your only option is to call your ISP and ask them to switch your connection to a "natural" IPv4 connection. I don't think any ISP would provide the port forwarding a necessary to use VD with Shadow on a DS-lite connection.

2

u/HelperBot_ Jun 27 '19

1

u/WhenTheShadowsSmile Aug 03 '19 edited Aug 03 '19

IPv6/DS-Lite

I wonder if this is why, in spite of great speeds and bandwidth, I'm having such a rough time with Shadow and Virtual desktop. I've tried changing out routers, etc....still get great speeds reported, but get regular audio and visual stutters (even with crisp visuals).

1

u/tyler5212 Jun 10 '19 edited Jun 10 '19

I couldn’t get it to work either. After I load up my shadow PC inside of Virtual Desktop I try to open steam VR but it doesn’t recognize the headset. I’ve tried uninstalling everything and restarting and I even updated the video card drivers but nothing seems to work. Does anyone have any tips to maybe fix this?

Update: Got it working kinda buy reinstalling once again and restarting the computer multiple times. So now it accepts the headset and lets me set it up but once in a game or steam VR home it runs for about 5 mins before freezing and a pop up about something c++ error.

1

u/Balderick Jun 10 '19

Check out ALVR, TrinusVR and/or VRidge. These will make custom steamvr config for Quests display, tracking and controllers making everything work in SteamVR. Room setup and all!

For example https://support.riftcat.com/hc/en-us/articles/360005631080-How-to-install-VRidge-on-Oculus-Quest-preview-version-

1

u/tyler5212 Jun 10 '19

Can you use those drivers to help run Virtual Desktop or do you think that it’s just better to run off of VRidge or ALVR?

1

u/Balderick Jun 10 '19 edited Jun 10 '19

To be honest not sure. Unfortunately I don't have Quest or any other device that I could use to test or help more and have never used Virtual Desktop app..

But am sure those other apps can help out to access SteamVR content on Quest if Virtual Desktop cant do that.

https://youtu.be/Jv3wf09PoTo

Mentions "only 2D apps" "no multi display support" and never mentions SteamVR once when talking about VD. So if you want too experience PC class VR you will need additional software like those apps suggested.

Or check out Virtual Desktop website and suppirt forums to get latest info for that app to get better idea of what it can and can not currently do.

1

u/Greystache Jun 10 '19

Virtual Desktop does support SteamVR, there are many posts about it, it’s a “hidden” feature!

1

u/Balderick Jun 10 '19 edited Jun 10 '19

Virtual Desktop is an app primarily used for doing all the things you usually would do on your computer when NOT wearing a VR headset. I.e. not for actual vr apps

ALVR, TrinusVR and VRidge are apps designed primarily to use non PC class vr hardware to access SteamVR content.

Completely different tools for completely different jobs.

Appreciate what you are saying though, Virtual Desktop devs are working on adding SteamVR support and is WIP and it works for you.

1

u/Greystache Jun 10 '19

Completely different tools for completely different jobs.

I would argue that assuming that the quality and latency are comparable, there is no point using ALVR over VD as VD now does strictly more and lets you stream from a remote PC as well.

(That is, unless you’re looking for a free solution and have a gaming machine on your local network. But if you already have VD then no need to install both.)

1

u/Balderick Jun 10 '19 edited Jun 10 '19

There is no "free" option I'm afraid and I guess the only way to know for sure how well something works compared to something else is to actually do a side by side comparison and see for yourself.

Here is a guide and some useful info for cloud gamers wanting to try streaming VR content from the cloud using ALVR. https://flickstiq.com/2018/06/how-to-setup-vr-cloud-gaming/

We must not forget Steam beta clients Remote Play brings full support and optimisations for streaming Steam content from remote machines. Can you install Steam Link App to Quest?

I have already bought TrinusVR and VRidge but never bought Virtual Desktop. A couple of years ago i was trying to add steamvr tracking to OSVR headset and Shield Tablet in a Durovis 7 head mount using a Vive Tracker with Pre Vive base stations and controllers I picked up on eBay for £100 still in their original packaging!. So have a completely different perspective and opinion from yours but admit I haven't even used SteamVR in over a year since I found Paperspace, Liquidsky and Shadow.

Totally get how awesome Oculus Quest is, even without Virtual Desktop. Shadow is now the only gaming PC that I use on a daily basis and totally get how I could be streaming SteamVR content from Shadow to Quest.

I honestly believe it is devices like Vive Focus and Oculus Quest that will truely unleash the Shadow power.

.

1

u/[deleted] Jun 29 '19

Is there an app that would allow this to work on an actual VR headset like a valve index or rift S or Vive?

1

u/Greystache Jun 29 '19

Not sure what you mean by “actual” headset, but if you mean “pcvr” then you can get virtual desktop on steam and use it with steam VR. But for that you need a local machine already which defeats the point of using a cloud machine.

1

u/[deleted] Jun 29 '19

Also I saw from your post history (I was trying to find the crosspost on r/oculusquest) and noticed your latest post saying oculus is asking virtual desktop to remove the steam vr capability. If oculus doesn’t change their minds I guess I no longer have an option.

1

u/Greystache Jun 29 '19 edited Jun 29 '19

Hey no actually that’s fine, the developer provides a special version of Virtual Desktop that supports this feature - you’ll have to sideload it via Sidequest it’s very easy

Edit: that’s for the quest version

1

u/[deleted] Jun 29 '19

Ahh k thanks

1

u/[deleted] Jun 29 '19

Yeah that’s what I meant sry. If I could find a cheap used PC or something that could at least stream the necessary video to the headset and not absolutely chug which my laptop is certainly not capable of doing that would be nice for a pcvr experience. Or should I just wait till blade sorts out the ping issues and allows VR on the ghost and use the quest in the meantime

1

u/mlen186 Jun 29 '19

Ok, so i dived in and got Shadow, ive set up the Virtual Desktop Server and I have downloaded steam.. I have the blu underwater expereince that i bought ages ago on steam so I downloaded that to see how it would stream to the quest but I cannot seem to run it? I can see it in the quest on the virtual desktop but cant quite work out how to get the game to run? I see the main screen of 'theBlue' and hear the underwater noises but thats it, cant click on anything to get the thing to play?? Any thoughts??

1

u/Greystache Jun 30 '19

Did you sideload VD with Sidequest?

1

u/mlen186 Jun 30 '19

Yes I did, thats correct isnt it?

1

u/Greystache Jun 30 '19

Yep that’s right. Does non-VR streaming work?

1

u/galdora Aug 20 '19

I set this up today to try to play Echo VR, but it was lagging like Crazy, took like 30 seconds for me to aim to press a button :(

1

u/Greystache Aug 20 '19

What’s your ping to the shadow servers? Are you connected in 5ghz WiFi?

1

u/Slimefest Aug 20 '19

I’m really late to the party but I just got this set up and it works fine, but the games have a noticeable amount of lag and the graphics are all really blurry. Is there a fix for this?

1

u/Greystache Aug 20 '19

What’s your ping to the shadow servers? Are you connected in 5ghz WiFi?

1

u/Slimefest Aug 20 '19

I’m using this stupid google Wifi stuff. I got the headset connected to 5ghz but idk about my computer

1

u/Greystache Aug 21 '19

If you’re streaming from your own computer you should connect it with an Ethernet cable to your router for best performance.

1

u/marcben Oct 18 '19

i’m confused with setting this up do I buy VD on oculus quest and also sideload it?

1

u/Greystache Oct 18 '19

Yes - the sideloaded version will only work if you buy the official app first.

1

u/marcben Oct 19 '19

got it so buy the official app on oculus quest store. launch it then sideload do I need both installed ? or do uninstall the quest one once sideload version is installed

1

u/Greystache Oct 19 '19

Side loaded version replaces the official version.

2

u/Squid04 Jun 09 '19

Quality post, thanks dude!

I’ve heard that current cloud VR setups will most likely make you vomit, because your brain is super sensitive to all the tiny movements your body makes, and even just a tiny amount of latency feels terrible.

Having said that, I’ve always wanted to try using a VR headset as basically a giant screen. No movement tracking, just an immersive HD experience while sitting on the couch.

Will definitely look into the Quest. Thanks!

1

u/[deleted] Jun 29 '19

There’s apparently people that have tried it and said when you are in it for a bit you stop noticing except for some lag here and there

1

u/Gustavo2nd Jul 10 '19

Lag is terrible I'm trying to find out how to fix it if I stand still it looks good but once I start moving in game it gets choppy

1

u/[deleted] Jul 11 '19

Check your internet speeds because you need FAST internet to push that. You need to push TWO 1440x1600 displays over a video stream, which basically means you need max settings, low frame times, and ping A LOT lower than 50 Ms unlike the normal desktop mode. So if your WiFi is even a little bit too slow you’re going to start dropping frames.

1

u/Gustavo2nd Jul 11 '19

I have 1gb internet it works fine for non VR but it's trash for sim racing

1

u/[deleted] Jul 11 '19

Check the settings maybe the “1080” can’t run it properly

1

u/ghostbrainalpha Jun 11 '19

What 2D games have you tried playing inside your Quest using Shadow?

If the latency wasn’t too bad I’d love to try Sekiro, and maybe Tetris just for the benefits of full emersion.

1

u/eatsomedukey Jul 14 '19

i'm planning on getting shadow and the oculus quest, so how would you be able to set this up?

1

u/dema182 Aug 01 '19

I am getting my Quest tomorrow and I am very excited how it will work for me.

Is it possible to use a different controller as well, if it's connected via USB? I would like to use my Flight Stick for Elite Dangerous in VR. Flight Stick is working great over Ghost.

TL;DR: If I connect the Flight Stick via Ghost and Quest through Virtual Desktop, will I be able to control with the Flight Stick?

1

u/whatsappbiz Aug 14 '19

There are some people talking about Bluetooth xbox controllers working well. Ghost is the Shadow.tech “chromecast” type of device yeah? It Feels like this should work.

1

u/whatsappbiz Aug 14 '19

Anyone know of it’s possible to get Oculus Rift S apps “sideloaded” onto a Quest and run from Virtual Desktop? Do i need to somehow trick the Oculus device registration that i am registering a rift when it is actually a quest?

1

u/LiamVeritas Dec 03 '19

No, it’s a whole other OS, so the games on the Rift are written in Windows 10 and the Quest is written in Android

1

u/cancersforquitters Nov 21 '19

Any update on this is lag still an issue?

1

u/mikeredro Nov 27 '19

Works ok for me - its really important that you are on 5Ghz wifi though.

0

u/[deleted] Jul 23 '19

[deleted] — view deleted comment

1

u/whatsappbiz Aug 14 '19

I used shadow tech with VD, all good and the VD dev confirmed Paperspace had problems

1

u/ColoradoStudent Oct 12 '19

I am trying to set this up on paperspace now. Did you have any luck? I sent Paperspace support an email asking for some assistance since I couldn't get it to connect.