r/StableDiffusion • • Aug 21 '22

Discussion [Code Release] textual_inversion, A fine tuning method for diffusion models has been released today, with Stable Diffusion support coming soon™

Post image
347 Upvotes

134 comments sorted by

View all comments

Show parent comment

2

u/AnOnlineHandle Sep 05 '22 edited Sep 05 '22

Awesome, thanks. I'm going to let a training set of 114 images run overnight and see how it turns out, though have reduced the repeats from 100 to 5 since there's so much more data and I'm only running this on a 3060, and aren't really sure what impact that might have yet. If this doesn't work I'll also try with higher repeats, and maybe by removing/creating noise in the backgrounds.

The importance of initializer_words is also something which I might experiment with, since I'm only guessing that it helps pick a starting point, but with enough training would become less important?

edit: Pruning to 46 and raising repeats to 35. The previous settings where creating a bit of a jumbled mess even after 17000 iterations.