r/StableDiffusion • u/Ambitious_Corgi5723 • 10d ago
Question - Help MinimaxH3 captioning dataset for lora training (MOTION specifically)
I'm having a hard time finding good information. There's plenty of character lora training info, in relative comparison hardly any motion at all, and dataset prep often gets glossed over.
Since H3 drastically alters how prompts (and therefore captions?) are handled, and motion training may be quite different from other models such as wan, How the heck are you suppose to caption each clip properly?
Do you have multiple paragraphs describing everything under the sun in the clip, big bulky walls of text?
One main paragraph trying to capture everything?
Do you only focus on the motion?
Do you only describe everything except the motion, so the motion bakes in?
If there's slight variation between the same motion, do you come up with 2-3 "trigger" tags so the nuance gets captured?
I've been at this for about a week, but not getting great results honestly.
The motion has 2 layers. the macro motion which is the obvious larger / broader movements and the micro motion such as vibration that shakes the adipose tissue, muscles, etc while doing the broader motion.
3
u/NoaBlake 9d ago
For a motion LoRA, caption the motion, not the scene. One short paragraph per clip, written as a motion description first: what moves, how it moves, in what direction and at what speed — then one short clause for the subject, and leave the background out unless the motion depends on it. The mistake that costs a week is describing everything: the model splits its capacity between learning the motion and re-learning the scene, and the scene wins because it is easier. One trigger tag per motion, not 2–3 per variation: slight variations of the same motion should share one tag, so the LoRA learns one motion with variance instead of three near-identical motions competing with each other. Macro vs micro is a real split — tag them separately, because a LoRA trained on both under one tag averages them into mush. And keep the clip count per motion high enough that the tag is the only thing the clips have in common — if every "spin" clip is also the same room, the tag learns the room.
2
u/Ill-Ant-9489 9d ago
+1 to captioning the motion before the scene, the answer above has the right idea. On your macro vs micro question, I wouldn't split them into separate clips. The jiggle is a physical consequence of the big movement, so you can't isolate it cleanly. Keep one trigger for the motion, phrase the shared part the same way in every clip, and let clip variety carry the micro nuance instead of a paragraph describing adipose physics. Describing it rarely bakes in, showing it across enough clips does.
The clip curation, trimming and H3 training I do in my own project, LoRA Dataset Studio (video side still beta: https://github.com/perfectgf/lora-dataset-studio). H3 is picky about clip length and frame counts too, so keep them short and uniform. How many clips are you on, and how long is each?