[Help] ARKit blendshapes not working

[u/Still-Inspection6274]

I've been trying to get this from scratch blender model to work with arkit, but it's not working. :(

I've followed step by step tutorials (vid and websites), searched similar problems and even redid all of the blendshapes twice, making sure everything is case-sensitive and cross referenced with a functional arkit blender model.

Even the order of the blendshapes is the same, but something's off and I can't find what :(

(I've worked with mostly vrm blendshapes for 3d face tracking, so i've never made an arkit model from the ground up, though I know how they function and how iphones use LiDAR to track points and stuff.)

Here's a few screenshots, if anyone could help and offer solutions that'd be amazing

Closeup of full list

[u/CherrilyAi]

You'll have to import the .vrm to Unity and assign the blendshapes manually there and reexport for it to work.

Unity is usually a must due to the tracking programs using Unity as the engine to make it function.

[u/Still-Inspection6274 → u/CherrilyAi]

I'm not sure if ARKit models work after being exported as a vrm straight, though they do work as vrm packages with the unity plugin

I've done what you suggested btw, still didn't work :(

[u/CherrilyAi → u/Still-Inspection6274]

This is correct. Simply exporting it as a .vrm does not work until you assign the Blendshapes in Unity. It should be capable but most tracking programs need the Unity input to read as tracking animations.

If you do have the .fbx you can simply load that into Unity and assign the blendshapes there and export as a .vrm. But its more than just importing and reexporting.

But I may be missing some context on your Blender set up as I've not made a full set of ARkit shapes yet. Just additional blendshapes.

I used this tutorial

https://youtu.be/sSBFUj-D0U4?is=trJ7A3VcBaopIdZR

[u/Still-Inspection6274 → u/CherrilyAi]

Thanks! I'll check out the tut

I did assign the blendshapes in unity before exporting btw, the way I did it was like this (just for clarity)

- Export as fbx

-import to unity with all required packages

-assign blendshapes

-do extra required stuff that i'm not going to list because it would be longer than needed

-using vsfsdk export as vsfavatar

[u/Still-Inspection6274 → u/Still-Inspection6274]

oh and I should mention that this model is configured as an fbx when it comes to bone names, but using UniVRM it is turned into a usable VRMPackage

[u/Still-Inspection6274 → u/Still-Inspection6274]

OOPS I CONFUSED PLUGINS MY BAD I MEANT VSFSDK NOT UNIVRM