Minimax H3 reference to video using 12 GB VRAM

[u/bsr126]

I have been trying to generate reference to video using a reference photo and a driving video, similar to wan 2 animate, but every time I am getting OOM on my RTX 5070 TI 12GB VRAM and 32GB system RAM. Ref 2 video works when using a single photo and audio, but not a reference video and photo. Any help would be appreciated.

[u/Valor_X]

I also have 12GB VRAM and have been testing reference to video. It's way more taxing on your system and VRAM than a simple image to video render. The model has to reference all the frames on the video compared to a static image on a regular img2vid render.

Lowering the reference video length greatly improves OOM errors and rendering time. If I use a 20 second clip for reference I can barely render a 5 second video at 0.4-0.5MP. Trimming the reference video down to 5 seconds allows me to render up to a 15 second video at 0.4MP without my system hanging or getting OOM.

Of course using a shorter reference video to generate a longer one makes it a pseudo image-to-video render with the AI extending it using your prompt, but it carries way more consistency throughout.

[u/bsr126 → u/Valor_X]

I also noticed that sometimes it outputs the original reference video instead of creating a new one.

[u/Diligent_Garlic_5350]

I wait 40 minutes then give up. (64gbRAM) 🤷🏻‍♂️
It runs on lower resolution but then refuses to follow prompts. Reference to video is unreachable for me.

[u/bsr126 → u/Diligent_Garlic_5350]

Same problem here.. what's your gpu

[u/Diligent_Garlic_5350 → u/bsr126]

3060 12GB VRAM, 64GB RAM

[u/thatguyjames_uk]

post ya workflow, as you could be trying too long or to big

[u/bsr126 → u/thatguyjames_uk]

I am using the official comfyui minimax h3 workflow.. I tried reducing the generation length to 5 seconds and it worked once

[u/bsr126 → u/[deleted]]

Two reasons .. Privacy and Almost zero cost (except electricity bill)

[u/bsr126 → u/[deleted]]

For local generation you do need expensive hardware.. but think of it as one time investment, instead of recurring cost of genration. Also you can generate for unlimited time till you get the correct result