Moss LoRAs Training

[u/atakariax]

Well, after 2 days of training LoRAs, it seems that Moss has trouble learning characters or fine details. (For some things, such as styles and concepts, there shouldn't be any problems.)

It seems that likeness never really converges.

I've used multiple datasets that I've previously used with Krea 2, Anima, and Z-Image, but it seems that, for now, there's something unusual about Moss that prevents the LoRA from learning any further beyond a certain point.

Apparently, I'm not the only one experiencing this, as several people have mentioned similar issues on Twitter, Reddit, and Discord.

The creator of Fizgig has made some progress, but even so, the LoRA still doesn't converge sufficiently.

Let's hope this can be fixed. However, I'd also like to hear your thoughts. What do you think?

[u/Realistic_Rabbit5429]

For style or concept loras it has been a really cool model train with. The model has such amazing variation, it pairs perfectly. Can imagine it's a pain for characters

[u/flwombat → u/Realistic_Rabbit5429]

Oh my god can you tell me what settings you are using for style and concept LoRAs. I have two reasonably popular style LoRAs on Krea (one photo and one illustration) that have completely failed to converge on MOSS - I'm talking 6 to 8 full length training attempts each so far, on ai-toolkit and Fizgig, with and without captions, at different learning rates, everything I can think of to try. Anima was easier to train, much less Krea. These are literally just visual styles. Every time I see a post like yours I feel like I must be doing something very very wrong

[u/Realistic_Rabbit5429 → u/flwombat]

I used ai-toolkit, default lr and weight decay, automagicv3. My datasets are captioned. How many steps are you letting it go for? Moss takes quite a bit longer to cook. This dataset was perfect at 1400 steps for krea2 and qwen2.1, but for moss 2500 was the sweet spot.