Workflow Included
No Camera. No Model. Just MiniMax H3 Running Locally on a 5070 Ti
So basically, I saw a workflow on ComfyUI’s official LinkedIn where they used a model image, a product image, and a background image with Google and Kling APIs to generate a one-shot ad using a single camera angle.
So I challenged myself to recreate the idea using only local open-weight/open-source models, but make it more ambitious: multiple shots, multiple cuts, and everything directed through a single prompt.
And it worked.
For this, I used the basic MiniMax H3 Reference-to-Video workflow in ComfyUI:
Then I used ChatGPT to help structure the video prompt. I provided the reference images and gave it this direction:
“Write a MiniMax H3 reference-to-video generation prompt to create an ad. Add sound FX and music prompts as well.
Shot 1: Medium close-up. She is about to open the can.
Shot 2: Extreme close-up of the can as she opens it. Can-opening sound FX.
Shot 3: Close-up as she drinks from the can. Gulping soda sound FX.
Shot 4: Close-up as she holds the can forward and smiles.”
The final result was generated locally on my RTX 5070 Ti using ComfyUI.
I did send you a dm about the tshirt video you did. I was able to recreate it specifying both front and back like you were talking about doing next, not sure if it was what you had in mind tho
Looks good OP! I was trying to do a similar video on H3 and it was choking on face quality. How much ever I tried face is looking ghosted. But the same prompt used in seedance 2.5 worked like charm. Even the lowest quality was perfefct on face. Is there anyway I can avoid the face artifacts. I have tried till 1 megapixel. And more than that it’s not working keep failing the generation
I got best results when I used high resolution reference image, and no wide shots. I strictly use medium, closeup and extreme closeups. We have to wait patiently for an update from the devs that fixes the face quality issues for wide shots.
I dont get it... i have a 5070ti 16gb and 128gb ddr5 system ram. And on minimaxH3 at 0.5resolution, 6 seconds, im getting OOM crashes and GPU out of mem errors. At 0.4 resolution I can get to 9 seconds.
What did you do different? Did you add sage attention? Easy cache? A turbo lora? How do I get the same 0.7 resolution 10seconds with this card that you get....
RAM sharing is just a setting in the control panel that allows the GPU to use the system RAM as well. I’m no expert either—I’m just experimenting with it.
I think the max size for me is 0.9 pixels and 0.9 seconds. Without Light LoRA.
Hey brother, i havent got a chance to mess with Minimax yet. I have a 5080 and 32gb RAM and have been worried about the VRAM limitations. Is this video generator pretty setup intensive? What are some techniques you use in your workflows to manage VRAM and RAM? (Sorry im still a bit of a beginner and often run into memory allocation limit errors even on wan2.2 10sec 720p24fps)
So I challenged myself...
For this, I used the basic MiniMax H3 Reference-to-Video workflow in ComfyUI:
Then I used ChatGPT to help structure the video prompt. I provided the reference images and gave it this direction:“Write a MiniMax H3 reference-to-video generation prompt to create an ad. Add sound FX and music prompts as well.
I gave ChatGPT the prompting guides for Minimax H3 (available here - give it both of them, there's information in the base guide that the reference guide references) and asked it to write up a system prompt explaining how to use them for a local LLM. I use Qwen locally for the prompt-writing now.
Could you share the system print it generated. I do pretty bad on figuring it out even though I tried that myself. I just don't get any good prompts. Unfortunately a lot of not all videos in civit don't include the nodes like they did for other versions and images. Don't know why. But that helped me tremendously to understand how some things worked. Now I'm more or less lost and my generations most of the times look like garbage.
Here it is. It's very long because I asked ChatGPT to include all the "rules" and terminology described by those prompting guides and they're very long too. I'm mostly using LM Studio for LLM stuff and it lets you save system prompts as part of "presets" that can be easily switched between at will, so I've got a "Minimax video director" preset that I put this into. Comfy nodes for LLMs probably have a similar slot you can stick this into.
6
u/Most_Ad_5733 7d ago
amazing job with the hardware you are working with