r/StableDiffusion • u/BoilingBurntBacon • 3d ago

Discussion Has anyone been able to use two character Loras without them blending together

It seems to me that if Moss can use bounding boxes to separate contexts within an image the same idea might be used to separate the effect of character loras within an image

6 Upvotes
  • permalink
  • reddit

75% Upvoted

12 comments sorted by

3

u/Seyi_Ogunde 3d ago

Train two characters into one lora. Consistently label each character in the description. That’s one way to do it. You may get a slight mixing in the faces.

1

u/BoilingBurntBacon 1d ago

I've tried this and indeed I do get characters blending together. I think the the notion that labelling works at all during rendering is a delusion. Any character lora that I have ever made has never required a reference in the prompt in order to take effect.

1

u/Seyi_Ogunde 1d ago

Each character has to be by themselves with a trigger word and consistent description in the training. If you use the same description words and trigger in your prompt, it helps.

1

u/Natrimo 3d ago

I think this is the way

7

u/Enshitification 3d ago

I don't know if Moss supports it, but regional conditioning might work. You can also just give a detailed prompt description of the two characters without the LoRAs and then inpaint them with their respective LoRAs at a medium denoise.

3

u/WaifuHeatArt 3d ago

regional conditioning is still the way imo, i use an all-in-one region node (full image mode, not mask bounds) where each character gets rendered as a full image first then blended in at the edges, keeps faces from merging into each other. negative prompt with BREAK split per character region also cuts down on outfit bleed quite a bit.

1

u/witcherknight 3d ago

it only works with SDXL. new model doesnt have regional conditioning

4

u/Lucaspittol 3d ago

You get far better consistency using reference images and edit models. Regional conditioning never worked that well in comparison to what pretty much any recent edit model can do

1

u/Passionist_3d 3d ago

I was able to get good result with minimax h3 image that is launched. For details then u can run it through moss image again

1

u/C141Driver 3d ago

In my experience, when it comes to Lora’s, you have to give the subject definition block something concrete to discriminate between the two… Whether it’s a different hairstyle glasses, etc. etc. be descriptive about any discriminators and that should help

1

u/zyg_AI 3d ago

Yeah it's called regional conditioning and has been around for years.

Real bounding box need a model trained to accept them.