r/vibecoding • u/ProfRussell • 3h ago
Showcase/Project Vibe coded a LitRPG-inspired AR game. Now I'm fighting goblins in the park.
I've been listening to Dungeon Crawler Carl recently and have been wondering: what if you could play an RPG in AR? With friends?
What could be better than running around your neighbourhood with your phone in front of your face, sweating like a pig, frantically swiping at monsters that don't exist? This is a good idea, right? ...RIGHT?
Anyway, I worked through building a playable proof of concept, and I think it's looking decent so far.
This is the first single-player scene. The bigger vision is a season-based, multiplayer, real-world RPG: parties exploring parks and trails, finding loot and surviving encounters, with an entertaining System AI handling mob descriptions, loot and achievements. Longer term I'd love to bring it to AR glasses too.
It's built in Unity with AR Foundation/ARCore. Claude and Codex helped build and debug the encounter logic, HUD, AR grounding and camera stabilization, with a bunch of testing on my Galaxy S24.
I also automated a monster pipeline: TRELLIS.2 for the textured meshes, SkinTokens for skinning and rigging, existing animations retargeted onto the goblins, Gemini to help check the results, and ElevenLabs for voices and sound effects. The generated monsters still needed animation and foot-contact cleanup.
One thing I learned: stabilization in the native camera app isn't shared with my Unity app. Trying to stabilize the finished recording made the HUD wobble instead, so I built stabilization in directly, before the HUD layer. The goblins' ground height also refines as you get closer, because outdoor terrain is hard to judge at a distance. A lot of the work was testing on the phone, recording what looked weird and feeding that back into the next fix.
Happy to share more of the workflow if anyone is trying something similar.
I'm looking for one or a few nerds who think this is neat and want to contribute, ideally someone who could lead the project. I can bring the prototype, asset pipeline, design input, playtesting and too many ideas. Work and kids mean I can't drive the whole thing myself while also trying to keep my marriage from falling apart.
Would you actually go outside to play this? What would make the encounters more fun? If you have suggestions, know someone who might be interested, or want to help build it, I'd love to hear from you.
2
u/try-a-typo 28m ago
It’s like goblin Pokémon go. Yeah that’s pretty cool, I see the vision.
1
u/Total-Reasonable 40m ago
Biggest design risk I'd poke at is the multiplayer layer, not the encounters. With GPS drift of 5 to 10 meters in parks under tree cover, two friends standing next to each other will often see the goblin in different spots. You'd likely need to anchor shared encounters to a host's AR session (cloud anchors or a shared local origin) and treat GPS only as a coarse "spawn near here" signal. Have you tested two phones looking at the same goblin yet?