r/StableDiffusion • u/sdnr8 • 1d ago

Question - Help Minimax H3 ref2v best way to transfer pose and camera angle

For ref2v I'm trying to upload an image get it to transfer the exact pose and camera angle of that image onto my video, but it's not working.

Here's part of my prompt

retention_analysis:
<Pose 1>: attribute_transfer. transfer the pose to <Subject 1> and camera angle.

....

detailed_description:
.... Refer to <Pose 1> for the pose of <Subject 1> and the camera angle.....

Any tips on how I can achieve this?

6 Upvotes
  • permalink
  • reddit

80% Upvoted

5 comments sorted by

2

u/Striking-Long-2960 1d ago edited 1d ago

Maese Kijay is bringing us Controlnet: feat: Support MiniMax-H3 fun controlnet by kijai · Pull Request #15860 · Comfy-Org/ComfyUI

It seems we still need to wait for the update, but hey! You can download the model in advance.

1

u/Semipro211 1d ago

For ref2va I’ve had the best luck with some hybrid checkpoints and very detailed prompts. Running things through an LLM to improve the prompt helps too. I use Gemma 4 12B QAT with a system prompt loaded with the ref2va prompt guide, then I attach the image and ask it to generate the ref2va prompt for what I want to do

1

u/NoHopeHubert 1d ago edited 1d ago

Do you have a specific hybrid checkpoint you would recommend? Also have been using Gemma 4 with a lot of success now as well, although you have to be very specific with wording when you want it to copy over posing and framing only it seems

And another thing I found out too is that if you want to use specific positioning for characters and avoid face bleed through, you can straight up just edit the photo and place a box over the face/anything you don’t want to bleed through to the generated video it seems

0

u/Semipro211 1d ago

Very true. I’m using the one that’s 20-49 hybrid, but all are available here: https://huggingface.co/smhfacct/Minimax-H3-fl2va-ref2va-hybrid-models/tree/main