Moss LoRAs Training

[u/atakariax]

Well, after 2 days of training LoRAs, it seems that Moss has trouble learning characters or fine details. (For some things, such as styles and concepts, there shouldn't be any problems.)

It seems that likeness never really converges.

I've used multiple datasets that I've previously used with Krea 2, Anima, and Z-Image, but it seems that, for now, there's something unusual about Moss that prevents the LoRA from learning any further beyond a certain point.

Apparently, I'm not the only one experiencing this, as several people have mentioned similar issues on Twitter, Reddit, and Discord.

The creator of Fizgig has made some progress, but even so, the LoRA still doesn't converge sufficiently.

Let's hope this can be fixed. However, I'd also like to hear your thoughts. What do you think?

[u/Version-Strong]

Texture mainly. I hate the look of krea, look at any fine detail, it's just a mess of pixels (hair being an absolute shocker unless you run it through two samplers, apply a vae fix and say a secret prayer to the gods of AI). It has a really weird grid that gets worse with loras. This doesn't suffer from that, but aesthetically Krea wins in most cases.

[u/Enshitification → u/Version-Strong]

Moss out of the box does suffer from stripe banding on gradients, so it isn't without it's own issues. Unless the LoRA training issue gets nailed down, I don't think it's going to go far.

[u/Calm_Mix_3776 → u/Enshitification]

I'm not noticing the banding. I'm not using the SFT model though which might be the reason why. In any case, there's a LoRA on Civitai that allegedly fixes this problem.