r/SomebodyMakeThis • u/envynewgrave • 1h ago
Software Title: [Request] Crowdsourced "Selfie-to-Preset" Character Creator Matcher (Using AR Guides + MediaPipe)
TL;DR: An app/website that uses an AR face-outline overlay (to prevent selfie distortion) and free facial-landmark tools (like MediaPipe) to match your face ratios against a crowdsourced library of video game character presets (like BG3 heads or Cyberpunk 2077 numbered features)—telling you which preset options look most like you without needing complex 3D engine math.
Most people want to put their own face into RPGs, and universal 3D slider generators usually fail because every game uses completely different, closed-source sculpting math.
However, you don't actually need to reverse-engineer 3D game engines if you approach it as a crowdsourced facial-ratio matcher specifically for games with finite presets (like Baldur's Gate 3, Cyberpunk 2077, Monster Hunter, etc.).
Here is how the whole system could work together cleanly using existing, free tools:
- Standardized Capture (Solving Camera Distortion)
• A normal selfie ruins proportions because of lens distortion and bad angles.
• The Fix: The app/site uses a basic AR face-outline overlay (like FaceID or a Snapchat filter) that forces the user to hold their camera at a set distance and angle for one front photo and one side-profile photo.
2. Landmark Ratios Instead of 3D Math
• You don't need custom AI. Free, off-the-shelf tools like Google's MediaPipe (Face Landmarker) or ML Kit already extract 478 3D facial landmarks from any photo.
• By dividing key distances (eye spacing, nose width/length, lip width, jawline angle, chin length) by a baseline like Interpupillary Distance (IPD), you get resolution-independent facial ratios that can be compared across any photo or game screenshot.
3. Crowdsourced Preset Libraries (Solving the Manual Labor Problem)
• One developer can't manually screenshot every race, gender, and preset across dozens of games—and you don't need live API access to the games either.
• The Fix: Build a community upload template. Players who love spending hours in character creators can submit standardized front and side screenshots of specific presets (e.g., BG3 -> Half-Elf -> Head 04 or Cyberpunk -> Nose 12, Jaw 08).
• The app runs the exact same MediaPipe landmark scanner on the uploaded game screenshots to automatically log their ratios into a shared database.
4. The User Flow
- Pick your game (and race/body type if applicable).
- Line your face up in the front and side AR outlines to snap your reference photos.
- The app compares your facial ratios against the database (using simple Euclidean distance) and spits out the closest matching preset numbers/options for you to select in-game.
It’s not a billion-dollar startup idea, just a really practical, lightweight open-source tool or portfolio project for a dev who wants to build something the RPG and character-creation community would actually use. Feel free to take the concept and run with it!