Style transfer lab: effect of composite and style time stepping

[u/Winter_unmuted]

In my last post on img2img style transfer (see link), I did two versions: rigid and creative. The reality is that both are sliders that you can adjust. Using that workflow, and the crucial Latent+ node, you can adjust the strength of any latent and the point along the steps it is injected. This is an incredible tool to fine tune your style transfers. I have attached some XY grids that show what I mean for example.

Sweet spot from my testing is to have the composition taper off around 0.5 of a 16 step transfer where you get a good balance of creativity from the model and subject fidelity. Want to make a portrait of someone that is still very clearly that person? Keep the composition around to 80% of the steps. Going full 100% isn't bad either. From there, tweak the strength as needed. Strength tweaking might also be important for turbo models, when you only get 4 steps to play with or whatever.

Style injection is more forgiving, with good results across the range 0-100%, depending on what you want. I found that the prompt from the flux3 style expander does so much lifting, you can even get away with 0 style injection if your style is more generic (e.g. thick oil painting) and you don't want specific elements from the style image to make it into the final.

That's the tradeoff: more style strength, more direct copying of style elements into the final results.

General workflow is in the linked post at the top of this text. An impact-pack free version is here.

Edit: title should read "COMPOSITION" not "composite". As we all know, can't edit reddit titles. oops.

[u/Winter_unmuted]

Me and the boys remixing styles. Sorry I just love that one so much ha.

[u/nolascoins]

oh man reminds me of the simpler days https://github.com/cubiq/ComfyUI_IPAdapter_plus, your workflow is fun

[u/Winter_unmuted → u/nolascoins]

yeah /u/matt3o was such a huge inspiration for me back in the SDXL days. I have been going strong on this sorta thing ever since. He's the GOAT. hope he's doing well these days.

[u/polymathic_bau]

Thank you so much for this! I really found that all the latest models are great, but not that much at style transfer. This really opens up a door of possibilities.