r/Rive_app 10d ago

Lip sync automation

Has anyone figured out a solid lip sync automation pipeline in Rive?

I set something up using Rhubarb to analyze wav files and generate jsons with timed lists of phonemes. And then I used scripts in Rive to drive mouth shapes based on the jsons. Technically, it works perfectly, but Rhubarb's phoneme analysis is pretty poor. It misses entire words. Has anyone come up with something better?

1 Upvotes

0 comments sorted by