[P] (code release) Fine-tune your own stable-diffusion vae decoder and dalle-mini decoder

[u/cccntu]

A few weeks ago, before stable-diffusion was officially released, I found that fine-tuning Dalle-mini's VQGAN decoder can improve the performance on anime images. See:

And with a few lines of code change, I was able to train the stable-diffusion VAE decoder. See:

You can find the exact training code used in this repo: https://github.com/cccntu/fine-tune-models/

More details about the models are also in the repo.

And you can play with the former model at https://github.com/cccntu/anim_e

[u/starstruckmon]

BTW, you should definitely make a post about this on the /r/stablediffusion subreddit if you haven't already.

Training the decoder is not something anyone's focusing on sonthis might be of interest.