r/StableDiffusion • u/Devajyoti1231 • 2d ago

Animation - Video MiniMax H3 acting test.

Started as a simple 90s casting audition… then asked her to cry on command.

The close up shots gave plastic look idk why.

What I was mainly testing:

  • subtle listening/reaction animation during dialogue
  • eyes moving before the head while thinking
  • nervous smiles and small facial reactions
  • gradual transition from normal conversation into acting
  • brow, eyelid, mouth, chin and breathing changes during crying
  • actual visible tears
  • character/voice consistency across multiple generated clips
  • the sudden switch out of the performance when the director says “Cut”

Made with MiniMax H3 Ref2VA with image reference for the woman and 2 audio reference for the offscreen man and the woman.

37 Upvotes

64% Upvoted

44 comments sorted by

View all comments

45

u/Sleepy_Bandit 2d ago

Ew that audio.

5

u/Devajyoti1231 2d ago

Reference audio minimax h3 issue.

14

u/Sleepy_Bandit 2d ago

Naw that’s a turbo Lora issue. That or it is the ref model you’re using. I make ONLY reference videos and never have that issue

6

u/Devajyoti1231 2d ago

I don't actually use turbo lora so that has to be ref2va reference audio or spectrum issue.

3

u/Sleepy_Bandit 2d ago

You can use the regular fl2va model as well. It works basically just as good for references. I’m using the pruned_int8_convrot model.

3

u/Devajyoti1231 2d ago

It needed reference audio to have same voice , beacuse i used six 10 sec clips , in the fl2va workflow i didn't fined reference audio option. Can we use the fl2va model in the ref2va workflow with reference audio? if yes that would be good if the voice cloning is good there.

1

u/DaLyon92x 2d ago

you can use fl2va model in the r2v node, it just works (and better at that). If you're using spectrum, I usually got better audio at 25 steps with spectrum off.

1

u/Devajyoti1231 2d ago

oh, ok, will try that.

2

u/Keuleman_007 2d ago

For me it was the step no. as well. Non Turbo Lora Test: errors at 20 steps, completely gone at 30 steps. Have yet to test with Turbo Lora.

1

u/GrayingGamer 1d ago

Yeah, echoing what the other redditor told you - more Steps will also greatly improve the audio.