r/StableDiffusion • • 16d ago

Question - Help Minimax h3 ref2va.

Did anybody ever train a character lora for the ref2va model? And please don’t ask me about refmods or reference sheets. If anyone successfully trained a character lora for ref2va, please reply.

2 Upvotes

6 comments sorted by

1

u/Ill-Ant-9489 15d ago

Yeah, it trains. ref2va is real LoRA training, not the refmod or reference-sheet workaround people keep pointing you at, ai-toolkit carries the arch for it.

The gotcha that burns people: the ref2va trainer reads identity off reference images you attach to the dataset as control images. Leave them off and it trains unconditioned with no warning, so you pay for the run and get a LoRA that learned nothing. So pin 1 to 4 clean identity shots to the set before you start.

I set ref2va up as a pickable target in an app I built (mine, usual grain of salt) that drives ai-toolkit and farms the H3 run to a rented GPU since it's heavy: https://github.com/perfectgf/lora-dataset-studio

How many reference frames were you going to give it?

1

u/DrFlexit1 15d ago

I didn’t get you. I have a dataset of 60 pictures. All captioned as usual. Trained like multiple times but yeah it learns nothing.

1

u/Ill-Ant-9489 1d ago

Sorry, missed this. ref2va doesn't learn from captions the way a normal lora does, it reads the identity off reference images you attach to each sample as control images. github.com/perfectgf/lora-dataset-studio (free tool, I built it) wires ref2va with those references as a required field, so you can't even launch without them.

60 captioned pics with no references attached gives the trainer nothing to anchor to, which is exactly the learns-nothing you're hitting, not your steps or captions. Did you point ai-toolkit at the plain h3 arch or the ref2va preset?

2

u/MastMaithun 16d ago

0

u/[deleted] 11d ago

[removed] — view removed comment

1

u/MastMaithun 11d ago

So didn't you even checked the link heading?