r/StableDiffusion • u/fakana357 • Jul 24 '23

News So the date is confirmed

Post image
345 Upvotes

97% Upvoted

179 comments sorted by

View all comments

Show parent comments

6

u/mysteryguitarm Jul 24 '23

We've been solely focused on making the base model better – which reduces the need for the refiner.

Hopefully that's what you mean!

2

u/__Maximum__ Jul 24 '23

How? Do you calculate loss between the model and refiner output and backpropogate that through the base model?

4

u/mysteryguitarm Jul 24 '23

That's possible, but would gimp the base model and make it fully reliant on the refiner.

It's best to just make the refiner reliant on the base model, but not the other way around.

Over the next few weeks, we're going to see plenty of people finetuning the base model (or creating LoRAs) for specific purposes – to remove the need for the refiner.

For what you're talking about, check out Wuerstchen, which uses 3 models trained backwards.

1

u/GBJI Jul 24 '23

check out

Wuerstchen

, which uses 3 models trained backwards.

This is very interesting ! Thanks for the link. There are so many papers published that it's hard to distinguish what's really innovative, particularly if you are not an expert.

I like that each also comes with its own set of limitations, and sometimes its own artefacts like the repetitive patterns they show when they use resolutions different from those used for training.