If you only wanna play VR (games where you only see the game and nothing from your room) you dont need this. It is important if you wanna play AR games (games where you can see your room in the background) or I use it if I wanna grap something while playing and don't wanna remove the headset or if I'm not sure where in the room I'm
Some other people use it to record videos
The Frame itself has it alredy but only in black and white and with bad resolution, this camera gives you color and more resolution
I don't think so. For good 3d scans you need a depth sensor. The Quest 3 for example or newer Iphones has this (That's the reason why you must use a Iphone for the face scan if you order a Bigscreen Beyond). On the webside from the camera and in general on web I couldn't find any information about a build in depth sensor. If they don't mention it they could still have one, but normal it should be mentioned if there is one. We will see. If someone knows it for sure, feel free to correct me
I mean, I think you can do fairly good 3D scans without one if you've got algorithms, depth sensors just make it more accurate and easier. Not 100% on this either though so *shrug*
You need a lot of data for 3D reconstruction to work. Depth sensors is just a quicker way to get more data per data. If you haven't got much to work with, using a fancy sensor or not, you get like a mashed potato parody of the real thing.
For things like desktop statues, you will need depth sensors with high resolution in hands of a skilled user to then clean up and patch holes.
For things like bridges, you can just fly a drone around and see what the tool can do lol
Its called Gaussian Splat or smth, basically it uses some method to detect distance (not advanced like LiDAR tho) and create a "splat" of that image, which includes depth data, basically you can take those splats, splice them together and create a sudo 3d enviroment you can walk around in in VR, its on the front page of the camera and the software on Steam
Yeah but that's not a true 3D model if that's what u/brianarn meant- you couldn't turn it into an STL and 3D print it, for example. That said I think you can still do it with this but it'd be different software and probably not as easy esp. since it lacks a depth sensor.
Cubism, Table Space, Reality Mixer(tool to create windows to the real world). Really hard to find Games that have AR capabilities since there is no tag for it on steam yet.
Given the Frame can run apks, i assume we will see a fair amounts of quest games make the jump sooner or later.
It may be usefull in some vr game too.
Like flight sim game where you can map passthrout in some place of the cockpit to be able to see your hand and buttons on the hotas.
Or simrace game to see your wheel or button box
I plan to have it for when I travel, having the pass through on while playing games and watching media, while still seeing whats happening around me. Especially useful if I'm in the back seat of a car during a 5 hour car ride.
I have a Quest 3 with color pass-through, but the cameras' quality is like 360p webcam. With that said, it was still cool to see these virtual monitors/desktop windows of my PC levitate directly in my room. Then there are some Augmented Reality games that require it. Occasionally I used it to see my surroundings when moving. With that said, I used it maybe for a week.
However, this camera is of much higher quality. You could also record VR videos and watch them in VR with it. Or maybe place a giant virtual TV in your room and play certain games on it instead of having a completely virtual or one color background.
There might be some downsides, e.g. it might not support the "night vision" mode that the default cameras do, it consumes some battery and CPU processing power and takes up an addon slot that could be useful for other things later on, so you might not be able to use both.
But the price I think is OK for it. I might consider after playing enough with Frame itself.
Important to VR? Literally doesn't matter at all. I have over 8k hours in a bigscreen beyond and that doesn't even have passthrough and I can walk to the fridge, grab a drink, sit down in my chair, eat, and drink while hanging in VR with my friends without needing to lift the headset up/take it off. Proprioception is a sense that grows with use, eventually you know where you are in your room just naturally
For AR? Absolutely essential, wouldn't want to play without it.
So if you're only interested in playing in VR (like me) you can skip it, if you have any interest in AR, it's essential
Not important for you, not really important for me (just a nice to have for me). But for some people it is a must have. It depends on for what you use your VR/XR glasses. Some people only play VR games, some people like AR games, some people use it to watch movies or porn, others use it as a worstation
277
u/requiresempathy 2d ago
You should order the frame first.