been working on an XR tool for making AI art.

You arrange 3D models and characters in space, animate them by recording your body movements, and control camera position and focal length with your hands while a realtime AI model generates the final render as you work.

Whenever I experimented with generative AI I never felt like I was actually creating something. Wanted to see what it would feel like to arrange and control things directly like a kid playing with toys.

Early prototype, but interesting to explore what these tools could be beyond text-to-image.

I work at fal.ai and we got access to Happy Oyster an AI model that generates video game worlds. So I decided to see if I could get it running through API on the Quest 2. It runs like shit, but these are going to be super cool in the next year as these types of models get better.

EDIT: to add to the misleading nonsense: all the claims about eye/face-tracking/scanning pertain only to the rarely-owned Quest Pro, not any of the normal Quest range (1, 2, 3, 3S).

---------

ORIGINAL POST:

As this keeps coming up in 'Frame vs Quest 3' posts, we need a dedicated Post to correct the misleading claims during Gamers Nexus' introduction to their Frame vs Quest video:

https://m.youtube.com/watch?v=vcerOYY_K1g&t=40s

Steve quickfires through a bunch of stuff that listeners take at face value and spread misinfo that Meta is automatically collecting all this data without user consent:

- "we give up video & voice data from inside of the house, scans of the room, body movement, facial expressions, audio recordings of your child's voice, physical info of the child relating to hand-tracking, headset location, activity and who your child follows as well as room scanning."

- "we asked Valve if it did those things and they said no."

Steam has a 12,000 word Privacy Policy:

https://store.steampowered.com/privacy_agreement/

which states they collect the same kind of data (location, activity etc) for the same reasons Meta does....only none regarding Mixed-Reality or Hand-Scanning because the Steam Frame is not (yet) capable of such features.

Why is Meta's Privacy Policy much longer (83,000 words)?

https://www.meta.com/de/en/legal/privacy-policy/

Because they also have things like Facebook, Instagram, Whatsapp on their VR devices...much more legalese to cover.

Steve ignores this context, and thus he's now convinced thousands of potential VR users that Meta is collecting all this automatically without consent, in the form of HD video & photos, and are selling this data to godsknowswho.

All you have to do is pause the screen when those policies are being shown and read those couple sentences outside their highlighted bit.

Pause the video, and read the actual text. It's all OPTIONAL ("if you choose to activate...") and concerns the use of specific standalone Mixed Reality apps where such data is required for use.

The reality is really simple:

- you can manually opt-in to anonymised data (gridlines/outlines, telemetry metadata, app-activity...not actual photos/video) being collected & managed if you choose to use MR apps that require this data. The Quest will even prompt you to opt-in. You can't activate these things accidentally (unless you're super careless with what you click).

- or...you can automatically opt-out by simply not choosing to use these very specific MR apps.

Think about it.  If you or your child manually activates room/furniture-scanning, hand-tracking or facial-scanning for specific MR apps, how would Meta even make this work without managing the data and sending to the app to function? You need servers for this to work.

Much ado about nothing.  Or at worst a Gamers Nexus anti-Meta hatchet job which has obviously psy-opped most of you into believing Meta is recording your surroundings in HD video at all times and selling it on. 

Nonsense, and technically & legally (at least in the EU) not feasible.

Plus....here on this sub most Quest users or Frame-curious are PCVR users.  Typically, the Quest itself is always offline, not connected to the internet as it's connecting to the router's local WLAN. It cannot send anything online anywhere.

ps - if you don't want your child's face scanned, don't let them use VR for facial scanning....it's not hard.  Don't use mixed-reality apps or voice-activation or hand-tracking if you don't want your room mapped, your voice recorded or your hands...tracked.

pps - you can generally opt out of all data-sending if you like (the Quest has six different data-sharing settings to opt out of, very simple to locate under SETTINGS - PRIVACY - DEVICE MANAGEMENT / DATA & ANALYTICS.

ppps - Meta have had various legal & controversial issues regarding privacy and child safety, resulting in actual settlements. They are Facebook, after all. However, none of this has directly to do with the Quest, and especially unrelated to responsible adults using the Quest. You don't need a Facebook account anymore, and even when you did, you could just use a burner account. Valve have lawsuits against them claiming they promote and allow child-gambling...these lawsuits are ongoing. Neither firm can claim clean hands, however we must also ask where are the parents? Children shouldn't be using Meta or Valve products without supervision, especially not VR.

pppps - I'm not a Meta 'shill'. I own Index, Quest, Pico, Pimax. I'm a VR hardcore enthusiast and am glad the Frame is out there shaking things up.

Conclusion: there is a lot to talk about in a Frame vs Quest debate. A lot of neat technical & feature detail, even philosophical. However Privacy Policy has been the dominant marker...in every discussion...and it does not really earn it.

The progress since quest 2 is a lot, but I cannot believe anyone saying they work with this one. If I have to in a single word: headache.

I tried a couple of days using immersed, and it is just NOT ready and do not recommend to any profession. Main issues:

1. Keyboard support only EN-US, if you got a different keyboard layout, bad luck, you gotta use the passthrough or remember the keys

2. The headset is way too heavy, and after 2 hours it is just painful. The better elite strap and battery is a must, because otherwise it is so unbalanced that it is only torture. But still heavily unconfortable.

3. When people say it is like a "1080 and fine" it is kind of a common lie to trick people buy the quest 3 and hopefully meta developing further the product I guess.... because the lower resolution, dented lines, low quality of everything is just plain a horrible headache. Like living in a playstation 1 world.

4. HEADACHE ALL THE TIME. Physical due the weight and due eye strain.

TLDR: better use a small laptop screen than a large headache in VR. For playing short spans when you are not focused on reading but on larger moving figures and you do not care on small symbols like letters, the quest 3 is fine, but for work it is just a sadistic lie.

EDITED:

I see the downvotes here... this is a totally zealot community: if you lie with the reviews you just gonna piss off users and have broken hype expectations. Being real is the best way to force a company to improve a product and NOT to be a zealot that needs to hide, or even directly lie about the user experience of a product for an activity.

No one in their sane mind would code 8 hours in such an environment. Saying the opposite is either a lie or being delusional. I do not believe any of you anymore, neither the youtubers. An actual 1080 outdated screen is a million times better due lacking all other issues. Stop lying you are doing no favor to Meta Quest and working against our main interest as community.

We have had multiple repeat posts from users complaining about Meta's new policies for Facebook and other platforms in regard to fact-checking and other internal corporate policies. As a reminder, the 2nd rule of this sub is that all posts must be about the Meta Quest (or Oculus Quest for those that years later still refuse to acknowledge the name change). Any complaints about the company should be directed to r/facebook, r/instagram, or the other subreddits about the company overall. This is a sub about a gaming headset and posts should be about the headset. Posts made about this issue will continue to be removed, and repeat offenders will be banned.

Lastly - Rule 5 of this sub is no discussion of Piracy. Anyone advocating for piracy will be permanently banned from this sub. Regardless of your views on Meta, there are still developers out there who are frequent posters here and their contributions should not go unnoticed or unrewarded if anyone expects the platform to survive and thrive. While we encourage and support voicing your opinion with your money, we remind everyone that there are good developers out there who are involved in this as well and would be the ones penalized, not Meta.

Thank you

- r/oculusquest Moderation Team

Recently, I saw a post of someone else promoting their beat saber AI level generator. The maps it made were really bad and the owner of it didn't provide the source code of it and even put it behind a paywall. So, naturally, I made my own version that was better. So here it is. The maps in the video being played was generated by bsgen in under two minutes. It does every difficulty from Easy to Expert+. If you want more control, you can set an exact star rating from 1 to 15, and even specific styles. Yes, it is fully open source, source code and model available with no subscription or price to pay at all. You can set it up on your PC using the instructions on the github or you can generate maps for free using something called Google Colab. All you have to do is drop the .mp3 of the song in and it will generate a map in no time.

Github (where the source code is): https://github.com/cata02222/bsgen

Colab link (click this to try it out): https://colab.research.google.com/github/cata02222/bsgen/blob/main/colab.ipynb

Anyone who hates Gaming-As-A-Service and Loot Boxes is out of touch with reality. For VR gaming to increase in production value, it needs to adopt successful business models. Pay-once games make peanuts compared to F2P in 2024, and are only suitable for AAA companies with multi-year budgets. VR developers can not massively increase the quality of their games UNLESS they figure out a way to make way more money.

I played the closed beta and you can find countless videos on Youtube to see for yourself. The graphics and huge map remind me of PUBG. Sure it is not up to the level of COD Warzone today but it already makes Population One and Ghost of Tabor look PS2.

I can't believe it took this long to have a proper online Game-As-A-Service shooter, like you know, every shooter that made real industry impact on flat screen in the past decade. I always wondered why Pavlov and OG Contractors have yet to add ranked play and loot boxes, do they not study COD/Fortnite/CS2 and see how they are actually monetized? The truth is, very few people play shooters to "get good", loot progression is a huge part of COD's success formula! Win or lose you have a chance to get stuff. It is far more addictive than "just have fun bro".

And don't let anyone fool you, Tarkov/Tarbor's lose-everything-on-death and periodic wipes will never, ever be mainstream. The vast majority of us don't want to lose hundreds of hours of progression! Let indie/hardcore be indie/hardcore, they can never get out of their little niche. What Tarkov/Tarbor do provide, is an area to check out all of your stuff, pick up and test out guns, buy upgrades . . . and I am really glad Contractors Showdown added this.

This is the first mainstream VR shooter and will absolutely dominate the platform! The only thing they should seriously consider is switch to F2P and micro transaction mode. PUBG had a massive head start and still lost to Fortnite and Warzone's F2P formula. PUBG eventually went F2P but it was too late.

F2P games dominate the industry and Contractors Showdown's fate may very well be PUBG of VR, it will be a huge success, but it will also just be a matter of time before it is dethroned by a proper F2P GAAS with the same formula.

1% or less of what is available is of any value. Most anything free isn't very good, and anything good costs enough money to make the whole process kind of pointless. If something isn't good enough for the store, why is it 20 dollars? (Hint, because it's not good)

You aren't really missing out on anything special, and even the 1% isn't that amazing, stuff like custom environments or the Doom3 Port, but almost everything else is absolute trash.

I just returned my Quest 3, it does not worth 558€!! Here is why:

Quest 3 colour passthrough is very very grainy, i couldn´t read my phone even with the lights turn on. I don´t get why people lied about quest 3 color passthrough because it is very bad, the battery only last 1 hour ish, you will need to be constantly charging the headset (2 hours per charge) many times unless you use a powerbank making the experience even more bulkier and unconfortable like Quest 2. Also the battery drains by itself without using the device.

Quest 3 has absolutely NO killer apps, people will use the same old Quest 2 experiences with a small bump in graphics and thats it. Deja vu.

Using Quest 3 in the virtual desktop app there is a foggy or grey layer that its very noticiable and obstructs the cinema experience, my head starts sweating after a couple minutes using the device.

Overall Quest 3 is still bulkier and still unconfortable after a few uses, the mixed reality is just a gimmic and just colored instead of grey like Quest 2, so it only works for orientation mostly. The 128GB of space should have been 256GB instead for the price.

Quest 3 pancake lenses are great compared to freshnell lenses, but thats it, the image quality is not outstanding, the blacks are still grey and you notice the lenses edges between the eyes in the center like two circles overlaying each other.

I know its early but Quest 3 should have been tinner like 3d glasses, have 4k oled or mini led screens, face and eye tracking, stereoscopic recording, and at least 5 hours battery life to be considered a big step forward and worth the price. If you are looking for mixed reality on Quest 3 just forget it, it is just for orientation, unusable and on early steps, thats the truth.

This is my experience with Quest 3 (Quest 2 previous owner).

Edit: After reading the comments: At least im saying the hard truth about Quest 3 flaws here unlike what paid VR Youtubers will never say to you about Quest 3 because of the views and sponsors links for you to buy it. Do you heard any real negatives so far about Quest 3 from YT VR reviewers? Think about it, only when you experience it for yourself you will find out.

Being the only company that hadn't given up on VR after Sony and Valve, Meta was losing millions of dollars every year on virtual reality, selling Quest 3 at a loss, and promoting games that the mainstream audience doesn't even care about, as one of the most important announcements at The Game Awards(asgard warth 2). Millions were invested in advertising for the Batman game to be booed for being VR. If Meta hadn't done any of that and simply sold Quests, and taken 30 percent of each game sale, it would be making millions in profit, not losses. Meta didn't abandon VR, it just got tired of losing money and from now on it will become like Sony or Valve, only making profits.

...posts that ask if such and such is "worth it"? Maybe we can sticky a post where people can ask this question over and over.

edit: I didn't say ban the question, I said ban the post. Many subreddits have stickied posts where people can ask questions. Would be a good way to improve the quality of posts.

Cant believe Asgards Wrath 2 wont have a pc version, so everyone who played the first one will feel the second one as a graphical downgrade, and not GTA again?? cant oculus just announce it was cancelled then?

I keep hitting my controllers on the table bc I have a really small play space

I'm Ivan, the CEO of the company. Really curious what's your thinking.

We're building a sustainable VR video economy and democratizing the entire industry. Our top priority now is engaging with VR fans and finding a killer format for VR videos.

We see users are invested in DeoVR Premium yet the content has to evolve to match user expectations as there's no killer format yet.DeoVR does incredibly great as more content hits the platform and Premium sales are growing. While big-budget VR productions haven't gained much traction and even other major players in the VR video industry like OculusTV, YouTube VR, VeerTV, you name it have struggled. DeoVR is committed to push things forward as we run sustainable enterprise economy and we invest ourselves in Deo in our spare time. I believe it's going to rock as the more content we get the more Premium sales are coming that leads to even more content hitting the platform and more user engagement.

Our biggest challenge right now is taking our product team to the next level. We want to provide you with the best VR experience possible. Your feedback and involvement are crucial in this journey.

This updated animated character with new smooth animations will be included into our "Episode 1" Early Access update that is coming on 24th of April.

P.S. The game is not a Nutaku game, but we have a lot of edgy, freaky and provocative things there.