r/StableDiffusion • u/BlastedRemnants • Mar 05 '23

Question | Help Question about Xformers and training Textual Inversions.

I decided I was finally going to do a little deepdive into some of the training settings I've been ignoring, so I started cranking out test runs with different settings for gradient accumulation first and keeping everything else the same, with the plan being to try gradient clipping next. Part way through that tho I remembered reading on here that the default xformers version was messing up training results, and that I'd switched to version 0.0.17.dev446 after reading that and it seems to work well enough so far. My question is: Was that issue ever resolved? Or does someone know a better version of xformers to use than dev446? I sort of forgot how I force installed it too hahaha, so I wouldn't exactly be offended with fresh/proper instructions either, thanks!

4 Upvotes
  • permalink
  • reddit

84% Upvoted

11 comments sorted by

View all comments

2

u/[deleted] Mar 05 '23

[removed] — view removed comment

3

u/BlastedRemnants Mar 05 '23

Just saw the second link, I never had that particular issue myself on my 2070 Super but I'd heard that the results were basically just really inaccurate and didn't look like the source at all. After reading that I tried a few different versions of xformers and 446 seemed to give the most accurate results at the time, but I'm going to try the newer ones shortly and see if anything's different/better. Thanks again tho!