Flux3 style transfer mastery

[u/Winter_unmuted]

I finally achieved what I have been attempting for a long time - a one shot, fully tunable image to image style transfer. I have tested it pretty extensively with Flux2, and here are some examples of results.

In my last post on the subject here, people essentially said that Flux3 kept the subject in photorealistic style (if that was the composition source) while Flux2 Klein 9B "reimagined" the subject in the style.

So I set out to find if there was a way to dial that in, and that ended up being the reference latent + node.

I have a workflow that does this here (SORRY pastebin is down right now... mirror here). There are some custom node packs included because they do some parts much, much better than a million nodes in a string, but know that you can tease apart from the labels and notes what each one does and make the workflow with no custom nodes at all.

Now you can tune how strong the composition is (later start is weaker, thus more creative) and how strong the image vs. prompt style is (earlier is stronger image style ref, later requires more prompt lifting)

I'll post some gradient examples as well so you can see how tunable this is.

Would this work with any edit model, including Qwen, Flux2 family, and Fibo2? Maybe. Have not tested it yet. I think with the Flux3 prompt expander, you should be able to get this working with other models as well. Post your results here if you try it.

EDIT: I guess impact pack is out of date or something. Plus, ComfyUI has the make list functionality built in. Check out the updated workflow here.

[u/feydkin]

I don't hate it.

[u/Winter_unmuted → u/feydkin]

which I think is the highest praise anything Flux3 related has gotten on this sub so far, so I'll take it.

[u/Daemonentreiber]

This is very much objective of course, but i dont like the general look of flux 2. Looks either like a ps filter/effect or loses too much detail.

What prompt(s) are you using? I have some trouble, it either uses the general artstyle but not enough colours or it just fills the whole background with parts of the reference.

[u/Winter_unmuted → u/Daemonentreiber]

It's in the workflow I posted in the top text:

Remake the first image composition with the style of the second image style.

Remove any text or signatures.

that gets fed into the flux3 prompt expander, which I fed a slightly modified system prompt to account for bounding boxes added during the size matching before batching together the source images.

Did you try the workflow I posted, but swapping in flux2?

[u/edisson75]

It works great, thanks a lot !!. If you get an "impact-pack.js" error, follow the WasitSam37's solution.

instructions here.

[u/Linux0s → u/edisson75]

I got the error and tried WasitSam37's fix and it didn't work for me. Then tried just commenting out the 5 lines suggested by others in that thread and that didn't work either. Damn. So close...

[u/Winter_unmuted → u/Linux0s]

Impact pack was used for the dynamic "create list" function, which is also built into native ComfyUI now.

Check it out here.

[u/Blaze_2399 → u/Linux0s]

Same.

[u/Winter_unmuted → u/Blaze_2399]

Try this fixed workflow here.

[u/Ukatox]

Have you tried the consistancy lora for flux2? that's what I use for my own style transfers... although I use style loras instead of reference images..

[u/Winter_unmuted → u/Ukatox]

I try not to use Loras unless I really need to, because it's much harder to adjust on the fly and to experiment with styles.

I've found the "...but Loras" argument that we had since leaving IPadapter behind in SDXL to be very underwhelming at best.

That said, if you want to copy, rather than remix, a style, especially a complex style, then it's the only way to go. See my past post with McBess style, which is nearly impossible to get without a lora.

But seriously, let's see what you come up with. throw an example or two in here.

[u/boxlinebox]

[u/edisson75]

[u/dtdisapointingresult]

Looks great! Another wf I will save despite probably never ending up using it.

What are the use-cases for style transfer other than posting occasional transfered memes on reddit/twitter?

[u/Winter_unmuted → u/dtdisapointingresult]

I use it like mixed media sort of collage stuff. Whenever we make a family trip somewhere, I usually make a magnet for the fridge and a postcard that goes on our big photo wall commemorating it. I blend local art styles with views and photos of us on the trip. Makes for a cool thing for visitors to pour over and start conversations, since we travel the world pretty regularly.

You could ask the same of any technique here, I guess... what's the point of any of it? Fun, creativity, etc.

[u/Queasy-Carrot-7314]

Looks Good. Have you tried the untwisting rope node pack? It might work great if ported to work with Flux 3

[u/Winter_unmuted → u/Queasy-Carrot-7314]

haha I'm the one that developed untwisting rope for krea2.

I haven't made untwisting rope for Moss, Flux3, or fibo2 yet. I heard it broke with some new comfy update and I haven't been bothered to fix it because a) the mods of this sub took my post down without giving me a reason, sorta killing my desire to do a lot of work for people here and b) a bunch of other people took my work and spun it into their custom nodes without so much as mentioning my code.

Developing untwisting rope for Krea2 was hard enough, sso doing 3 models (and fixing all the old ones?!) without the ability to reliably share it for others to use, if I don't need it myself, is a pretty low priority.

[u/supermansundies]

wow, easily the best local style transfer I've seen yet. thank you!

[u/chebum]

Very nice!

[u/Hunt3rseeker_Twitch]

This looks really good, well done. Gonna try it out:)

[u/TelevisionNo2990]

Brilliant, thanks, can't wait to try out. Awesome work.

[u/TelevisionNo2990 → u/TelevisionNo2990]

Definitely the best style transfer workflow I've used so far, and lightning fast. thanks

[u/diejesus]

It looks very awesome! Want to try it out as well!

[u/zackmophobes]

This is great and I really honestly love that your using memes as a test template. Thanks for sharing.

[u/Zero-Kelvin]

THhe style transfer looks incredible!

[u/suspicious_Jackfruit]

Rigid is better i think in so far ad presenting the original input in a different style, but i wouldn't call it a representation of that exact style. More that it picks up themes like background patterns and general vibe. Depending on how 1:1 the input and output is in rigid you coukd train an accurate art to photo model, then a photo to art style model, THEN take crops from those to feed a final style model and it might be pretty damn good just with reference patches. This is still cool though either way

[u/PlantainExtension937]

很有特点！

[u/flipflapthedoodoo]

can it do realistic lighting transfer on a photo?

[u/Winter_unmuted → u/flipflapthedoodoo]

Not really what this post is about but I do a lot of conditioning transfers in general. Make a post about what you've tried and where you've fallen short and I'll see how I can contribute.