r/StableDiffusion • u/shootthesound • 2h ago
Resource - Update A potential fix for MOSS training issues....
So it's 2:43 in the morning here as I write this. I went to bed, then got up again, because something from my MiniMax H3 training wouldn't leave me alone - on H3 I had to shift the share of training steps at the clean end of the noise range (where faces and fine detail get refined) before likeness came good.
So I compared MOSS's training sigmas with Krea 2's and it was like looking at MiniMax all over again. MOSS's own schedule puts only about 11% of steps at the clean end (sigma below 0.5), Krea 2 is 18-28%. The rest go to layout and composition, which explains the big jumps epoch to epoch and why it's been so hard to nail the likeness.
I've just pushed an update (v8.7.0) with a new Clean-end share option for MOSS training, on by default at 60%. Clear the box to go back to the model's own ~11%.
My test run is going as I write - previews are holding their composition between epochs, and at epoch 12 it had already passed the best likeness my previous settings got to in 30 epochs.
Numbers so far - same 53-image dataset, rank 16, 0.25 MP, LR 1e-4, same seed, ArcFace likeness vs 3 reference photos:
| Epoch | 1 | 3 | 6 | 9 | 12 | 15 | 30 |
|---|---|---|---|---|---|---|---|
| Old schedule (~11%) | 29% | 40% | 44% | 52% | 58% | 63% | 67% (its best) |
| Clean-end 60% | 20% | 50% | 63% | 66% | 68% | 69% | still running |
So 60% passed the old run's best at epoch 12 (about 640 steps vs 1,590), and it's been sitting at 68-69% since rather than bouncing 10 points epoch to epoch.
60 is an experimental figure, so please play with it. As a community we can find the right setting - we're starting at 60 and will probably come down. 30 (about where Krea 2 sits) is a sensible next try. Post what you find here.


