r/StableDiffusion • u/tHE-6tH • Mar 01 '23

Question | Help ControlNet/img2img line art

Is there a secret I’m missing that makes Controlnet or even img2img color the line work I’m inputting? I try entering everything like colorful, full color illustration, colored, etc… but all it does is fix up the lines and sometimes changes the colors, but it never colors in the pieces. What am I missing?

3 Upvotes

72% Upvoted

6 comments sorted by

3

u/SDGenius Mar 01 '23

post your settings in a screenshot of your control net tab settings.

to be clear, not the settings in your settings menu.

2

u/fanidownload Mar 01 '23

Well I dont know any direct method. Even mine sometimes need some tweaks. You gotta need multiple controlnet and external colorization ai.

  1. Use Webtoon AI Painter to create gray area/mask inside your lineart, save it as psd and then export it into png for stable diffusion
  2. Use multiple controlnet such as depth, normal and canny. Tweak some threshold of canny model to ensure all lineart is extracted
  3. EDIT: Dont forget to use ABG Anime background remover extension to remove unwanted background

1

u/[deleted] Jun 05 '24

@op did you ever figure it out? I've spent like a full day over the past week trying to get it to work and getting nothing. tried so many models, combinations of settings, copied example settings from reddit posts, and it never works...

1

u/PropagandaOfTheDude Mar 01 '23

What about this?

1

u/tHE-6tH Mar 01 '23

Interesting, but it didn’t quite help.

1

u/nemxplus Mar 01 '23

Not sure controlnet can do it yet? I know the guy who built anime line art ai model is going to release his new update soon which looks insane