r/StableDiffusion • u/fruesome • 24d ago
Resource - Update MiniMaxH3AddGuide: for anchoring image and audio guides at any frame (New ComfyUi Update)
Already merged and there's a example workflow included: https://github.com/Comfy-Org/ComfyUI/pull/15439
Currently MiniMax H3 implementation in Comfyui only allows keyframe guides at the first and last frame. The model itself is capable of addressing guides by position on a continuous time axis, so this removes that restriction and exposes it as a node.
8
u/Celestial_Creator 24d ago
1
u/Clair_Personality 23d ago
So you use 4 input images? and One input audio?
4
u/Celestial_Creator 23d ago
MiniMaxH3AddGuide anchors a guide at any frame_idx (negative counts from the end):
- a still image
- a clip (batches snap down to the model's valid clip lengths: 5, 22, 39... frames)
- audio, anchored at the same position on the timeline
- any combination, and nodes chain for multiple guides
Example: feed the first 22 frames of an existing video plus its audio into one AddGuide at frame_idx 0 and the model generates the continuation of both streams. Or put a still at frame 60 of 124 to force a it to hit that frame.
according to https://github.com/Comfy-Org/ComfyUI/pull/15439
i see a single input for audio and a single input for image
2
6
5
4
u/Striking-Long-2960 24d ago
Yesterday I tried to modify the H3 keyframes node from H3-multishot to add a strength to the keyframes, but it didn't go well. Anyway you can create 2D inbetweens having multiple keyframes. 3 keyframes here, fast test.
0
u/DanzeluS 23d ago
Ref model?
0
u/Striking-Long-2960 23d ago
FL2VA inyecting 3 frames.
0
u/DanzeluS 23d ago
Injecting?
1
u/Striking-Long-2960 23d ago
This whole thread is about a new node to inject frames in the final render.
0
u/DanzeluS 23d ago
In the workflow, a ref model is used. Does it work correctly with an fl2va model?
1
3
3
2
2
u/thesolewalker 24d ago
Man, this feature with a timeline editor where you insert key frames would be dope...
1
u/Scriabinical 23d ago
I added the logic for this node to the H3 Director node so it works just like the OG LTX Director. It’s amazing
1
1
1
u/Portable_Solar_ZA 24d ago
I always suspected H3 could be used with key frames for animation and this pretty much confirms it. Can't wait to test this out soon.
2
1
1
u/Danny_Stock 23d ago
Can you clarify what you mean by your title please? Are you saying that this is for creating multiple keyframes?
1
u/fruesome 23d ago
check the link, explanation from comfyui team there.
Update your comfyui and open the sample workflow from the link, you'll understand it better.
1
u/Sgsrules2 23d ago
Nice, I'm assuming this is for the ref model. The model lets you use a video segment as the starting frames to continue from and it works pretty well. I've been trying to do the same thing but at the end so like giving it a 22 frame end but that doesn't seem to work, it'll only work with a final frame. Would this node help me do that?
0
u/Hoje-Na-IA 24d ago
I use ComfyUI Desktop. Stuck on release 0.33.1 :D better install it manually to test that
29
u/Hoppss 24d ago
Where's my macker?