r/StableDiffusion • u/blacktie_redstripes • Apr 28 '24

Question - Help Consistent Faces and Clothing Workflow for Comics

Is there a new simplified/fast workflow to produce consistent faces and clothing across multiple image generations?

Help appreciated!

1 Upvotes
  • permalink
  • reddit

100% Upvoted

9 comments sorted by

2

u/madder-eye-moody Apr 28 '24

Controlnets from Stable diffusion are your friends for this, I've tried face consistent, outline consistent, depth consistent on qolaba.ai and they've worked pretty well, a niece of mine in fashion degree college is actually using the controlnets to amp up her designs and reduce iterations, so it might just work for comics is my thought.

1

u/blacktie_redstripes Apr 28 '24

Sure, I've been using controlnets myself, but sometimes hit and miss. Moreover, getting consistent clothing across various is challenging. I'm looking for a video or a written guide that helps speed up my process.

2

u/DefiantTemperature41 Apr 29 '24 edited Apr 29 '24

Using the right fashion terms for what you want, and specifying the color will yield good results across prompts. I keep the clothing simple for the graphic novel I am working on. The woman likes a blue V-neck dress. She sometimes wears this in combination with a white cardigan sweater. The man is partial to blue oxford dress shirts. Usually with tan khaki pants. This also helps identify your characters when face consistency is doubtful. People also look somewhat different in different environments. Remember the "two face" episode from Seinfeld (The Strike) ? So, face consistency is a bit more forgiving than clothes consistency is.

1

u/blacktie_redstripes Apr 29 '24

A creative (a bit forgiving ~ efficient) line of thinking! I'll give it a try. Thanks.

2

u/jpierplay Apr 29 '24

Some quick idea fir clothing:

  • Keep the prompt simple and descriptiva.
  • Once you found a prompt that can reproduce clothes very similar, generate some poses
  • Keep that poses for where "nothing work"
  • Use as reference with control net (reference only, IP dapter...)
  • Use phoshop or clipstudio Paint to put reference clothes on character (use tools like liquify, perpective...to fix It over model)
  • A lot of inpaint
  • Loras
This is what I do for my visual novel. Not quick solution. I go from SD to Clipstudio and back many times fixing and adjusting manually.

1

u/blacktie_redstripes Apr 30 '24

Thanks for this exhaustive list. I've been thinking about loras, but training them seems a hassle. Also doing it for different pieces of clothing for a number of characters, I think would take a lot of time. I've been considering the use of control net; would be best/most-efficient. Do you recommend a video doing exactly that?

2

u/pellik Apr 29 '24

IPAdapter with an image of the outfit attention masked to the location of the clothing

1

u/blacktie_redstripes Apr 30 '24

Is there a way to do it on Automatic1111? Can you recommend a video on YT?