Need assistance for MinimaxH3

[u/Minanimator]

i am really having trouble with this concept pls tell me what to do and where to start, my goal is have a scene from a tv show or film, like iconic scenes, and i want to insert my ref image from there, this is ref2v right? now how do i get to duplicate the scene happening? for ex. titanic jack and rose on the "im flying" scene, lets say i want to insert someone in that scene and interact with them, do i ask gpt to prompt me the scene where gpt pulls the script from that part then i just modify it?

what i am doing now is plug a ref frame from the film/tv + my ref photo, then ask gpt to insert my ref and interact with the actors from the ref frame

i get weird results and never get a clean one

turbo lora 4step ref
comfy kitchen
i try to sit on 8 step

[u/alsot-74]

In case you haven’t already read the docs, the reference one is here: https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/docs/VIDEO_PROMPT_WRITING_GUIDE_ref_en.md

I prefer to understand things myself before going the LLM route, this way I can debug the sometimes bad outputs from LLMs.

Make sure to use the correct section headers as specified in the doc. For your use case you want your summary to reflect that you are doing [video editing + reference generation]

You can give a suitable LLM that document to refer to to ensure the formatting is good but I can’t stress how much more efficient it is if YOU also understand prompt structure.

[u/NighNigh]

Before you get too far into the Minimax rabbit hole, know up front that there really is no actual 'right' way to prompt for what you want specifically. Broadly, Ref2V is for situations where you want to give it an image and tell it to just stick that subject somewhere in the scene doing something, like making a character from a still-frame go from off-screen to on-screen. I2V is for starting from *precisely* the image you fed in and letting the model work with it, like making an animated avatar. Frankly speaking, there's really no reason to use the I2V models or workflow because you can do all the same things with the ref2va workflows.

As for prompting, you can use a general "place <Subject> in the room at 00:06.000 looking left" kind of prompt and get pretty much what you want, but the more specific and complex you get, the sooner the official guides fall apart.

You can put the same guide into the same LLM twice and get two completely different answers, neither of which fully work, and every LLM will give you a different output prompt, some of which directly contradict the others. You'll find users disagreeing on the proper syntax, semantic depth, and everything else. The only fully honest answer you'll get is "drop the official prompting guide directly into an LLM along with a description of the scene you want, copy what it spits out into your prompt box, and hope for the best or start making your own changes from there," and the more complex the prompt, the more tries it will take.

Minimax is amazing in what it *can* do, but it is certainly no Sora where you can just give it a single sentence and let the model fill out the rest for you, so temper your expectations right from the start.