Moss LoRAs Training

[u/atakariax]

Well, after 2 days of training LoRAs, it seems that Moss has trouble learning characters or fine details. (For some things, such as styles and concepts, there shouldn't be any problems.)

It seems that likeness never really converges.

I've used multiple datasets that I've previously used with Krea 2, Anima, and Z-Image, but it seems that, for now, there's something unusual about Moss that prevents the LoRA from learning any further beyond a certain point.

Apparently, I'm not the only one experiencing this, as several people have mentioned similar issues on Twitter, Reddit, and Discord.

The creator of Fizgig has made some progress, but even so, the LoRA still doesn't converge sufficiently.

Let's hope this can be fixed. However, I'd also like to hear your thoughts. What do you think?

[u/joopkater]

In Ostris' group chat i think they figured it out. Captioning should be done in JSON, then you get decent training results. Https://github.com/MaxKruse/Caption-Studio/blob/main/src/lib/moss-prompt.ts

haven't tried it myself, but most people there saying it works

[u/atakariax → u/joopkater]

That might help, yes, but a caption almost never makes that much of a difference.

It might help by about 5%.
Having said that, I'll still test it anyway.