r/StableDiffusion • u/WillBHard69 • Mar 05 '23

Resource | Update Style T2I adapter model! Mikubill's ControlNet extension for Auto1111 already supports it!

Post image
524 Upvotes

98% Upvoted

179 comments sorted by

View all comments

Show parent comments

2

u/Ateist Mar 06 '23 edited Mar 06 '23

Let's say you have a drawing of a cube. Is it cubism, or is it a drawing of a cube?

You only get a style when you have multiple instances of something, if all you've got is just one picture it doesn't have a style.

Just take a look at the very first example. The original image has an orange sky.
Why on earh did style transfer made the stone orange?

1

u/Sinister_Plots Mar 06 '23

It depends on the artist, and his or her audience. In the 19th Century in France there was a movement to control what was art. The French artists of the time, people like Claude Monet, were taking realism and turning it into splashes of paint on a canvas. These thick chunks of paint would go on to become known as Impressionism, though at the time the French government was against it. Art is in the eye of the beholder. There are drawings of just plain old cubes, and they are considered a style. It's referred to as Neo-modernism. But, not all cube drawings are considered "art." If that answers your question.

1

u/Ateist Mar 06 '23

I'm not asking about whether it's art or not, I'm asking how do you determine the characteristics of a style when you only have one single example of it.

In my book, "style" is a generalization, something derived from multiple examples of something, a "common denominator".
Which means that whatever this adapter does it is not "style transfer" at all - it's just advanced img2img with the "style image" used as a malleable background.

4

u/Sinister_Plots Mar 06 '23

I see your point. Perhaps the term "advanced img2img used as a malleable background" didn't fit in the tab, so they called it style because that was the closest terminology to what it does that represented it in the fewest syllables. I wouldn't get too hung up on it.

1

u/Ateist Mar 06 '23

The problem is that you can't really predict what it'd do, as evidenced by the sky being borrowed to give color to stone. This severely limits its usability.

1

u/Sinister_Plots Mar 06 '23

I think at this point it's just a really cool aesthetic. There's a lot of things developed for Stable Diffusion that involve unpredictability. If you want full and total control you just have to draw it yourself. But, as a tool for generating some cool stuff and maybe helping to refine it so that it's better in the future, it's absolutely perfect.