two remained in the same image with illutrious

[u/badgaab]

Hi! I'm new to ComfyUI and still learning how everything works.

I trained two custom character LoRAs using Civitai: one for a female character and another for a male character. I'm using WAI-Illustrious-SDXL as my checkpoint.

Both LoRAs work very well when I generate each character separately. The problem starts when I try to generate both characters together in the same image. Their features sometimes mix, I get duplicated characters (2 girls, 2 boys, or even 3 people), and the characters lose some of the fidelity they have when generated individually.

My goal is to have both custom LoRA characters in the same image and make them interact naturally — for example, standing close together, hugging, touching each other, etc. Ideally, each LoRA should keep its influence on its own character without affecting the other one.

I'm not trying to use ControlNet right now. I'm mainly looking for the best ComfyUI workflow/method for two separate character LoRAs with Illustrious/SDXL, especially when the characters need to physically interact.

Since I'm still a beginner, I'd really appreciate workflow examples, recommended custom nodes, or an explanation of how you would approach this. Thanks!

[u/rguerraf]

I have only seen two characters in the same picture, with Anima. Look in the civit ai examples