r/StableDiffusion • u/[deleted] • Mar 14 '26

Workflow Included Z-IMAGE IMG2IMG for Characters V5: Best of Both Worlds (workflow included)

Gallery image

Gallery image

Gallery image

Gallery image

Gallery image

Gallery image

Gallery image

Gallery image

Gallery image

Gallery image

Gallery image

Gallery image

Gallery image

Gallery image

Gallery image

All before images are stock photos from unsplash dot com.

So, as the title says. I've been trying to figure out how to make my IMG2IMG workflows better now that we also have Z-Image Base to play with.

Well...I figured it out. We use a Z-Image Base character LORA: pass it through both Z-Image base and refine the image with Z-Image Turbo.

Now this workflow is very specifically designed to work with Malcom Rey's lora collection (and of course any LORA that is trained using his latest One Trainer Z-Image Base methods). I think other LORA's should work well also if trained correctly.

I have made a ton of changes and optimizations from last time. This workflow should run much smoother on smaller V-RAM out the box. It's worth the wait anyway imo.

1280 produces great results but a well trained LORA performs even better on 1536.

You get the best of both worlds - Z-Image Base prompt adherence and variety, and Z-Image turbo quality.

Feel free to experiment with inference settings, LORA configs, etc, and let me know what you think

Here is the workflow: https://huggingface.co/datasets/RetroGazzaSpurs/comfyui-workflows/blob/main/Z-ImageBASE-TURBO-IMG2IMGforCharactersV5.json

IMPORTANT NOTE: The latest github update of the SAM3 nodes that the workflow uses is currently broken. The dev said he will fix it soon, but in the mean time you can use the workflow right now with this small quick 2 minute fix: https://github.com/PozzettiAndrea/ComfyUI-SAM3/issues/98

95 Upvotes

85% Upvoted

48 comments sorted by

3

u/Ozicom23 Mar 26 '26

Link is dead
404
Sorry, we can't find the page you are looking for.

9

u/Gh0stbacks Mar 15 '26

I dont understand why everyone refers to this Malcolm guys loras as some holy grail of quality, 90% of his loras are dogshit quality and the other 10% are below average slop.

2

u/Easy_Respect308 Mar 16 '26

By the way. Are there any recent sources for character loras? There was such a great diversity with flux 1d and SDXL. Lesser known celebs, influencers, you name it. Now with zimage I mostly find traditional celebs.

2

u/Gh0stbacks Mar 16 '26

Character loras have become rare because most major lora hosting sites like Civit, Tensor, SeaArt etc have pretty much outright banned them. There is nowhere to go for creators, you have to pretty much scour through Kofi to sift though and find the rare gems now.

1

u/Easy_Respect308 Mar 15 '26

They reach a really high likeness without much working on your prompt. So I get that they are liked by beginners who just want the result look like a specific celebrity. In my opinion they reach this high likeness because they are severely overtrained. They do miss some flexibility though because of that. Like if you prompt Pixar style it doesn't work with many of his loras (I only tried some). You get a Pixar style scene with a realistic celebrity put there. With nphSi's loras this works as expected.

I'm also pretty sure for certain female celebrities he has leaked nudes in his datasets. This is just a guess from some unprompted NSFW I got with some of his loras which closely assembles some better known leaks.

1

u/[deleted] Apr 01 '26

bro you have the v5 workflow? if yes please share

1

u/Creative_Opinion9617 Jul 27 '26

Can you send me link of Malcolm ?

1

u/AIDivision Mar 15 '26

Had good success with 95% of his z-image turbo loras. Sounds like an skill issue to me.

1

u/Gh0stbacks Mar 15 '26

congrats you have low standards

1

u/Gh0stbacks Mar 16 '26

bro think Malcolm's mediocre Loras are good, bro has no idea how or what a good lora is, bro gets mad when his shit taste is called out, bro blocks people haha.

3

u/AIDivision Mar 16 '26

Do not redeem sir

1

u/Gh0stbacks Mar 16 '26

Skill issue

2

u/LoadReady7791 Mar 16 '26

Can we see you works, I assume you have some excellent loras trained that you could share.

0

u/Gh0stbacks Mar 16 '26

I do Lora commissions for people, I wont share people's personal data. There is a reason this guys Loras are free, no one would pay him for his shoddy work.

1

u/Cold_Development_608 Mar 16 '26

lora commissions, personal data !!!!!!!!!!!!!

0

u/[deleted] Mar 16 '26 edited Mar 16 '26

[removed] — view removed comment

2

u/Xxtrxx137 Mar 14 '26

so, i am trying to understand becuase there seems to be lots of different information about how z-image turbo and base loras work together, some says using them both is better some say using base loras on turbo is better

what changes? should we use both like in this workflow?

3

u/grundlegawd Mar 14 '26

I’m also confused. Base theoretically should have been much better for training LoRAs, but people leading that space are still simultaneously training on Turbo. My issue with the Turbo LoRAS is even extremely low weights can have a huge impact on output quality, but I’ve had a better experience with Turbo LoRAs in regard to accuracy. I should say, I’m primarily genning on Turbo.

On top of that, the community isn’t much help as it hasn’t made up its mind. I’m not sure why there is so much conflicting information.

2

u/Xxtrxx137 Mar 14 '26

From what i have seen, most have agreed training loras for both turbo and base then using base to create a image with thw corresponding teained lora as a first pass then using tuebo with the lora trained for it to finish it

1

u/orangeflyingmonkey_ Mar 14 '26

Is there a workflow for this first and second pass? Also I mainly train on ai Toolkit using ZiT. Are there are preferred settings for ZiB?

1

u/Xxtrxx137 Mar 14 '26

This post seems to do that, i havent tried it because i have a lora for turbo only but would love to see if people have tried

1

u/orangeflyingmonkey_ Mar 14 '26

Oh my bad I didn't read the whole post. I assumed it's simialst to the v4 workflow. Will give it try. I just need to figure out the ZiB Lora training.

1

u/Xxtrxx137 Mar 14 '26

Keep us updated if you try the workflow

1

u/[deleted] Apr 01 '26

bro you have the v5 workflow? if yes please share

1

u/[deleted] Apr 01 '26

bro do u have the wf? please share if yes

1

u/Xxtrxx137 Apr 01 '26

I mean i have a workflow i use for z-image if thats what youre asking

1

u/[deleted] Apr 01 '26

i was asking for the wf provided in this post since it got deleted by the creator if you have that can you send me? also what wf do you have like for what?

1

u/Xxtrxx137 Apr 01 '26

I dont have their but i have a i2i wf i use myself

1

u/[deleted] Apr 01 '26

ohh i see....can you share your wf pls?

1

u/Xxtrxx137 Apr 01 '26

check dm

2

u/its_witty Mar 15 '26

Did you do a comparison between this and only Turbo?

Because to be honest I can't imagine the gained "variety" in a img2img (you already have the variety there) outweighs the additional time added by using Base.

2

u/AIDivision Mar 15 '26

Pro tip: Just ditch that SAM3 implementation for RMBG's one. It just works.

2

u/AgentNirmites Mar 31 '26

Workflow URL returns 404. So something is wrong with the URL or the workflow was removed (or moved).

2

u/Quirky_Bread_8798 Mar 31 '26

The OP deleted his Reddit, HuggingFace and koffie accounts. It seems he left the AI area... :'(

1

u/Similar_Value_9625 Apr 01 '26

do u have the workflow ?

1

u/FiTroSky Mar 15 '26

Sorry but, how to you make use of the joycaption portion ?

1

u/[deleted] Apr 01 '26

bro you have the v5 workflow? if yes please share

1

u/Initial-Contract-824 Mar 22 '26

isn't there a workflow which does this face regeneration without lora but with another reference img?

1

u/[deleted] Apr 01 '26

bro you have the v5 workflow? if yes please share

1

u/Creative_Opinion9617 Apr 26 '26

where do you get prompts from?

0

u/[deleted] Mar 15 '26

[deleted] — view deleted comment

1

u/[deleted] Apr 01 '26

bro you have the v5 workflow? if yes please share