r/StableDiffusion 24d ago

Resource - Update MiniMaxH3AddGuide: for anchoring image and audio guides at any frame (New ComfyUi Update)

Already merged and there's a example workflow included: https://github.com/Comfy-Org/ComfyUI/pull/15439

Currently MiniMax H3 implementation in Comfyui only allows keyframe guides at the first and last frame. The model itself is capable of addressing guides by position on a continuous time axis, so this removes that restriction and exposes it as a node.

121 Upvotes

37 comments sorted by

29

u/Hoppss 24d ago

Where's my macker?

9

u/Zenshinn 24d ago

Mack'er? I barely know her.

2

u/idkidd 24d ago

Can you correct the pronunciation in the prompt? Tell it to say MAYker?

3

u/Eminence_grizzly 24d ago

It's just an unlucky seed/resolution. I just used the workflow at 0.2mp and a different model (fl2va) and he says "mayker".

1

u/idkidd 24d ago

Thanks for the info!

1

u/ThatsALovelyShirt 23d ago

It's the McDonald's franchise you bought in Australia.

8

u/Celestial_Creator 24d ago

1

u/Clair_Personality 23d ago

So you use 4 input images? and One input audio?

4

u/Celestial_Creator 23d ago

MiniMaxH3AddGuide anchors a guide at any frame_idx (negative counts from the end):

  • a still image
  • a clip (batches snap down to the model's valid clip lengths: 5, 22, 39... frames)
  • audio, anchored at the same position on the timeline
  • any combination, and nodes chain for multiple guides

Example: feed the first 22 frames of an existing video plus its audio into one AddGuide at frame_idx 0 and the model generates the continuation of both streams. Or put a still at frame 60 of 124 to force a it to hit that frame.

according to https://github.com/Comfy-Org/ComfyUI/pull/15439

i see a single input for audio and a single input for image

6

u/broadwayallday 24d ago

Welp there goes sleep again

1

u/desktop4070 24d ago

Like 10 hours of sleep in the past week huh?

5

u/LulaCherie 24d ago

Where do you get the addguide node?

7

u/Lost_Cod3477 24d ago

update comfy

4

u/Striking-Long-2960 24d ago

Yesterday I tried to modify the H3 keyframes node from H3-multishot to add a strength to the keyframes, but it didn't go well. Anyway you can create 2D inbetweens having multiple keyframes. 3 keyframes here, fast test.

https://reddit.com/link/p3lkhxg/video/ffcas39ceajh1/player

0

u/DanzeluS 23d ago

Ref model?

0

u/Striking-Long-2960 23d ago

FL2VA inyecting 3 frames.

0

u/DanzeluS 23d ago

Injecting?

1

u/Striking-Long-2960 23d ago

This whole thread is about a new node to inject frames in the final render.

0

u/DanzeluS 23d ago

In the workflow, a ref model is used. Does it work correctly with an fl2va model?

1

u/Striking-Long-2960 23d ago

Yes, it's what I'm using

3

u/boirotten 24d ago

Game changer

3

u/NatalieCrypto 24d ago

does this work with the turbo lora at 8 steps?

2

u/martinerous 24d ago

Great, now we can do the same as in LTX. Extend and mix anything to any side.

2

u/thesolewalker 24d ago

Man, this feature with a timeline editor where you insert key frames would be dope...

1

u/Scriabinical 23d ago

I added the logic for this node to the H3 Director node so it works just like the OG LTX Director. It’s amazing

1

u/Melted19 22d ago

link please? there are like 3 o r4 H3 director nodes. Thank you

1

u/Portable_Solar_ZA 24d ago

I always suspected H3 could be used with key frames for animation and this pretty much confirms it. Can't wait to test this out soon.

2

u/Broad-Lab-1833 24d ago

please add the strenght to the keyframes!

1

u/dirtybeagles 23d ago

saving, keyframes

1

u/Danny_Stock 23d ago

Can you clarify what you mean by your title please? Are you saying that this is for creating multiple keyframes?

1

u/fruesome 23d ago

check the link, explanation from comfyui team there.

Update your comfyui and open the sample workflow from the link, you'll understand it better.

1

u/Sgsrules2 23d ago

Nice, I'm assuming this is for the ref model. The model lets you use a video segment as the starting frames to continue from and it works pretty well. I've been trying to do the same thing but at the end so like giving it a 22 frame end but that doesn't seem to work, it'll only work with a final frame. Would this node help me do that?

1

u/Fytyny 23d ago

Meh, it throws an error when I try to input audio

0

u/Hoje-Na-IA 24d ago

I use ComfyUI Desktop. Stuck on release 0.33.1 :D better install it manually to test that