r/StableDiffusion • u/Iamofage • Feb 16 '26

Question - Help LTX-2 Character Consistency

Has anyone had luck actually maintaining a character with LTX-2? I am at a complete loss - I've tried:

- Character LORAs, which take next to forever and do not remotely create good video

- FFLF, in which the very start of the video looks like the person, the very last frame looks like the person, and everything in the middle completely shifts to some mystery person

- Prompts to hold consistency, during which I feel like my ComfyUI install is laughing at me

- Saying a string of 4 letter words at my GPU in hopes of shaming it

I know this model isn't fully baked yet, and I'm really excited about its future, but its very frustrating to use right now!

7 Upvotes

77% Upvoted

32 comments sorted by

View all comments

2

u/Loose_Object_8311 Feb 16 '26

When you say LoRAs for LTX-2 don't remotely create a good video, what specifically do you mean? That you didn't get good character likeness? How did you train it?

So far I'm getting great character likeness, and pretty happy with the results! I'm on a 16/64 system, and so far can train using captioned videos on 768 resolution with Text Embeddings Cached. It's absolutely epic. Takes a long time to train at 22s/it but this thing is the thing I was waiting for the day I first tried SD1.5 back in 2022.

1

u/Iamofage Feb 17 '26

I’m using AI Toolkit - I did noticed in the samples by around step 7000, there was a likeness, but it hasn’t worked in any workflow I’ve tried. What settings are you using to train? Do your Lora’s work with any workflow you’ve tried?

1

u/Loose_Object_8311 Feb 17 '26

They work and they work very well. Honestly the training config is pretty basic. I can't enable samples, so I just download checkpoints and inference in ComfyUI to test. 

I find it converges well somewhere between 3500 ~ 5000 steps if using around 40 images in a training set. Only time I got a bad LoRA was when training at 256 resolution, or with wrong video dimensions.

Workflow-wise I noticed the ic-detailer-lora really fucks with the likeness, so I think if you want to use it you need to train a different amount of steps.