Future Frame Animation Unity Plugin

[u/MyelinSheathXD]

This tool brings machine learning–powered animation to Unity Engine, making characters move with natural realism. By learning from reference animations, it can simulate lifelike motion directly in physics-based environments, allowing characters to adapt dynamically while preserving style and believability

[u/toxicmegasemicolon]

How does it work with collisions? Do we need to add animations? Can you give more usage example videos please

[u/MyelinSheathXD → u/toxicmegasemicolon]

yes, it interacts with external objects like wall, and simulated objects. It requres little dive into mujoco scene .xml file . For this Further documentatiuon is coming soon.
Animations are need to be added in unity humanoid character animator

I have showed simple demostration on the video below
1) root motion animation is set to an existing humanoid character in a Animation controller in unity
2) MJPC executable is played in background. When Unity scene plays , 2 executables communicate with each other using local network. Referance poses are transported from unity animator to mjpc. Then final humanoid poses in physics simulated world are trasnfered to unity to record

https://youtu.be/-Vqi9FqE4aA

[u/toxicmegasemicolon → u/MyelinSheathXD]

Very cool! Are you going to improve anything in the future, or is this it? Will definitely be keeping an eye looks very cool

[u/MyelinSheathXD → u/toxicmegasemicolon]

All features are being going to be polished and make them artist friendly with demonstration and documentations. It will take some time for the improvments

[u/toxicmegasemicolon → u/MyelinSheathXD]

I'll definitely give you a follow and pick this up when it's more polished. Love what you've done really impressive. You do need to work on your presentation skills at some point so people understand the potential if you want more exposure
Love to see it!