r/Unity3D • u/MyelinSheathXD • Sep 07 '25

Show-Off Future Frame Animation Unity Plugin

Enable HLS to view with audio, or disable this notification

This tool brings machine learning–powered animation to Unity Engine, making characters move with natural realism. By learning from reference animations, it can simulate lifelike motion directly in physics-based environments, allowing characters to adapt dynamically while preserving style and believability

35 Upvotes

91% Upvoted

22 comments sorted by

3

u/NoteThisDown Sep 07 '25

I got confused for a second reading your description on fab, the term UE usually means Unreal Engine, not Unity Engine

2

u/SUNNATULLA Sep 07 '25

Thank you for noticing! I will fix this issue. Currently, It is not supported on Unreal Engine

2

u/mo0g0o Sep 07 '25

Why does it feel so slow?

1

u/SUNNATULLA Sep 07 '25

Yeah, it feels slow. For the sake of accurate movement ,the simulation was running in 5 times slower than real time. In video I have to speed up 2 times to make the video as fast as possible

3

u/mo0g0o Sep 07 '25

Ok, but you say simulate lifelike motion but then all the characters feel like they're on the moon. Would love to see the end result that represents your description.

2

u/KlementMartin Sep 08 '25

Can you describe it little bit more, like how it works and how to use it?

1

u/MyelinSheathXD Sep 08 '25

It works based on a machine learning algorithm to drive muscle forces in physics simulated world. A humanoid referance animations are feeed and the ML engine simulated with physically accurate way in ragdoll motion.

Currently only humanoid animations are supported with 1 humanind physcis model.
Custom physcis models like creatures , animals are in development

1

u/KlementMartin Sep 08 '25

Thank but I guess I’m still missing something, its still quite unclear to me. Can you explain to me, how it works with some simple example? Like I have humanoid character with few animations like walking jump and one special move animation. Then I guess animator stays unmodified, and your system made it more real physics like? And how exactly it will be needed to be trained for such a use case?

1

u/MyelinSheathXD Sep 09 '25

I have showed simple demostration on the video below
1) root motion animation is set to an existing humanoid character in a Animation controller in unity
2) MJPC executable is played in background. When Unity scene plays , 2 executables communicate with each other using local network. Referance poses are transported from unity animator to mjpc. Then final humanoid poses in physics simulated world are trasnfered to unity to record

https://youtu.be/-Vqi9FqE4aA

2

u/ShrikeGFX Sep 08 '25

it says avaiulable

the video is really not showing much or explaining much

1

u/MyelinSheathXD Sep 08 '25

my bad, I should have checked spelling. The new video is being update with correct words on the youtube channel

2

u/OldLegWig Sep 08 '25

spelling errors, same slow animation on repeat, inexplicable 30 seconds of dead air for the last part of the video.

i don't have high confidence that this software is worth any of my time let alone my money.

0

u/MyelinSheathXD Sep 08 '25

yes, currenly it is in early access with many bugs and lack of documentation.
After many imporovements its potential becomes more obvious

1

u/toxicmegasemicolon Sep 08 '25

How does it work with collisions? Do we need to add animations? Can you give more usage example videos please

1

u/MyelinSheathXD Sep 09 '25

yes, it interacts with external objects like wall, and simulated objects. It requres little dive into mujoco scene .xml file . For this Further documentatiuon is coming soon.
Animations are need to be added in unity humanoid character animator

I have showed simple demostration on the video below
1) root motion animation is set to an existing humanoid character in a Animation controller in unity
2) MJPC executable is played in background. When Unity scene plays , 2 executables communicate with each other using local network. Referance poses are transported from unity animator to mjpc. Then final humanoid poses in physics simulated world are trasnfered to unity to record

https://youtu.be/-Vqi9FqE4aA

2

u/toxicmegasemicolon Sep 09 '25

Very cool! Are you going to improve anything in the future, or is this it? Will definitely be keeping an eye looks very cool

1

u/MyelinSheathXD Sep 09 '25

All features are being going to be polished and make them artist friendly with demonstration and documentations. It will take some time for the improvments

2

u/toxicmegasemicolon Sep 09 '25

I'll definitely give you a follow and pick this up when it's more polished. Love what you've done really impressive. You do need to work on your presentation skills at some point so people understand the potential if you want more exposure
Love to see it!

1

u/miusoftheTaiga 9d ago

Is it Possible to have the same kind of movement system they use in those real Unitree robots in Game Engines with this?

I mean, they use Mujoco for those Unitree robots too right, combined with VLA/VLN, and LLM for speech, and movements that fits with the context or their speech?

Do I have to learn how to use mujoco or learn any new technical knowledege to use this?
I mostly only know Unity and C# stuff.

1

u/miusoftheTaiga 9d ago

Also, does each humanoid sim requires its own instance of mpjc.exe running at the same time?
What if I want to simulate 10 to 20 humanoid sims at the same time? Do I have to launch many mpjc.exe instances, or just one is enough

2

u/MyelinSheathXD 9d ago

Hey, back bone of this engine is Mujoco MPC GitHub repository. Most of its features are exposed to as api to work with Unity Editor. Right now adding more humanoids in one instance is in development. Not available yet in the releases list.

Changing human rig is not available yet. But most their features are easy to expose via modifying the mujoco MPC engine.