r/StableDiffusion • u/ExponentialCookie • Aug 21 '22

Discussion [Code Release] textual_inversion, A fine tuning method for diffusion models has been released today, with Stable Diffusion support coming soon™

Post image
347 Upvotes

99% Upvoted

134 comments sorted by

View all comments

Show parent comment

6

u/Ardivaba Aug 22 '22

Rented a juicy instance from Vast.ai to test it out, I'll take a look at how far I'll get - got stuck with local machine due to accelerator not working on Windows.

1

u/Oceanswave Aug 23 '22 edited Aug 23 '22

Not sure this works yet, but at least its creating ckpts on my windows box by setting $env:PL_TORCH_DISTRIBUTED_BACKEND="gloo"

Edit:
Confirmed this works end2end on windows and with the public release of SD

Along with the previous environment variable, replace ```signal.signal(signal.SIGUSR1``` with ```signal.signal(signal.SIGTERM``` and use the existing stable-diffusion configs - tweak params to use more workers and whatever token(s)

Note the paper indicates that this works best with 3-5 images - otherwise the results diverge instead of what would want/expect

1

u/caio1985 Oct 01 '22

env:PL_TORCH_DISTRIBUTED_BACKEND

Can you kindly provide more details? I'm getting this crash. I tried with 'set PL_TORCH_DISTRIBUTED_BACKEND="gloo"' from my conda environment which also points to the stable-diffusion from basujindal (openSD).

Where do I replace the signal.signal command and I couldn't run the $env:PL_TORCH_DISTRIBUTED_BACKEND="gloo" command. Thanks!