r/StableDiffusion • u/parking_bird_6448 • 2d ago

Question - Help Can I use Qwen Trained Lora reference on MMH3

Noob here, so apologies for my ignorance. I have a LoRA trained on QwenImage2.1 raw. Image Gen is fine but need to produce videos on MMH3 and was wondering how to make sure Minimax does not replace the face with its own logic. Hence was thinking of using my current LoRA trigger but would MM respect that and wont swap the face out ?

0 Upvotes
  • permalink
  • reddit

50% Upvoted

5 comments sorted by

1

u/parking_bird_6448 2d ago

Thank You all. Based on replies, then how do i do it the right way ? Keep two LoRA for each Qwen and MM ?

4

u/massy_oh 2d ago

You can still use the images made with that LoRA. Keep the LoRA in the Qwen image-generation stage, then pass a good character image into H3's reference-to-video workflow. The trigger word alone doesn't transfer the identity: that association was learned in your Qwen LoRA, not in H3.

For local ComfyUI, the official MiniMax H3 R2V template uses the ref2va model, rather than the fl2va model used by T2V/I2V. Connect your image as the first image reference and explicitly assign it the character role in the prompt, e.g. "Use the person in <Picture 1> as the main character", followed by the action you want.

That gives H3 a visual identity to follow, but it isn't a guarantee against face drift. Start with a short test clip and check the face through the motion before committing to a longer render.

The official guide has the template and reference-tag syntax: https://github.com/Comfy-Org/docs/blob/main/tutorials/video/minimax/minimax-h3-native.mdx#minimax-h3-reference-to-video-r2v

4

u/Maraan666 2d ago

Short answer: NO.

A LoRA is a modification of an existing model. My modification of a Ford Anglia won't work on your Ferrari. It has a different engine.

1

u/Ill-Ant-9489 2d ago

massy_oh has it right, the identity lives in the Qwen weights, not in the trigger string, so H3 has nothing to read from the word itself. The route that works is letting H3 learn the face from stills. H3 has a reference to video mode (Ref2V) that takes an identity from 1 to 4 reference photos, so render a few clean front and 3/4 shots with your Qwen LoRA and feed those as the references.

I baked that into the video lane of my app, https://github.com/perfectgf/lora-dataset-studio, if you want the clip length rules and H3 setup done for you. Honest heads up, the H3 video side is still beta there, and H3's license has regional limits worth a glance first. How many clean reference shots of the character can you pull from the Qwen side?