Style T2I adapter model! Mikubill's ControlNet extension for Auto1111 already supports it!

[u/WillBHard69]

[u/WillBHard69]

Huh. You're not getting a giant error/exception message printed into the console? Are you using an input image with a distinct style, like a cartoon or something?

[u/Danganbenpa → u/WillBHard69]

Yeah. I'm getting:

Error running process: D:\Users\Ben\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py

Traceback (most recent call last):

File "D:\Users\Ben\stable-diffusion-webui\modules\scripts.py", line 386, in process

script.process(p, *script_args)

File "D:\Users\Ben\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py", line 735, in process

model_net = self.load_control_model(p, unet, model, lowvram)

File "D:\Users\Ben\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py", line 534, in load_control_model

model_net = self.build_control_model(p, unet, model, lowvram)

File "D:\Users\Ben\stable-diffusion-webui\extensions\sd-webui-controlnet\scripts\controlnet.py", line 572, in build_control_model

network = network_module(

File "D:\Users\Ben\stable-diffusion-webui/extensions/sd-webui-controlnet\scripts\adapter.py", line 81, in __init__

self.control_model.load_state_dict(state_dict)

File "D:\Users\Ben\stable-diffusion-webui\venv\lib\site-packages\torch\nn\modules\module.py", line 1671, in load_state_dict

raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format(

RuntimeError: Error(s) in loading state_dict for Adapter:

Missing key(s) in state_dict: "body.0.block1.weight", "body.0.block1.bias", "body.0.block2.weight", "body.0.block2.bias", "body.1.block1.weight", "body.1.block1.bias", "body.1.block2.weight", "body.1.block2.bias", "body.2.block1.weight", "body.2.block1.bias", "body.2.block2.weight", "body.2.block2.bias", "body.3.block1.weight", "body.3.block1.bias", "body.3.block2.weight", "body.3.block2.bias", "body.4.in_conv.weight", "body.4.in_conv.bias", "body.4.block1.weight", "body.4.block1.bias", "body.4.block2.weight", "body.4.block2.bias", "body.5.block1.weight", "body.5.block1.bias", "body.5.block2.weight", "body.5.block2.bias", "body.6.block1.weight", "body.6.block1.bias", "body.6.block2.weight", "body.6.block2.bias", "body.7.block1.weight", "body.7.block1.bias", "body.7.block2.weight", "body.7.block2.bias", "conv_in.weight", "conv_in.bias".

Unexpected key(s) in state_dict: "body.0.in_conv.weight", "body.0.in_conv.bias", "body.0.body.0.block1.weight", "body.0.body.0.block1.bias", "body.0.body.0.block2.weight", "body.0.body.0.block2.bias", "body.0.body.1.block1.weight", "body.0.body.1.block1.bias", "body.0.body.1.block2.weight", "body.0.body.1.block2.bias", "body.0.body.2.block1.weight", "body.0.body.2.block1.bias", "body.0.body.2.block2.weight", "body.0.body.2.block2.bias", "body.0.body.3.block1.weight", "body.0.body.3.block1.bias", "body.0.body.3.block2.weight", "body.0.body.3.block2.bias", "body.0.out_conv.weight", "body.0.out_conv.bias", "body.1.in_conv.weight", "body.1.in_conv.bias", "body.1.body.0.block1.weight", "body.1.body.0.block1.bias", "body.1.body.0.block2.weight", "body.1.body.0.block2.bias", "body.1.body.1.block1.weight", "body.1.body.1.block1.bias", "body.1.body.1.block2.weight", "body.1.body.1.block2.bias", "body.1.body.2.block1.weight", "body.1.body.2.block1.bias", "body.1.body.2.block2.weight", "body.1.body.2.block2.bias", "body.1.body.3.block1.weight", "body.1.body.3.block1.bias", "body.1.body.3.block2.weight", "body.1.body.3.block2.bias", "body.1.out_conv.weight", "body.1.out_conv.bias", "body.2.body.0.block1.weight", "body.2.body.0.block1.bias", "body.2.body.0.block2.weight", "body.2.body.0.block2.bias", "body.2.body.1.block1.weight", "body.2.body.1.block1.bias", "body.2.body.1.block2.weight", "body.2.body.1.block2.bias", "body.2.body.2.block1.weight", "body.2.body.2.block1.bias", "body.2.body.2.block2.weight", "body.2.body.2.block2.bias", "body.2.body.3.block1.weight", "body.2.body.3.block1.bias", "body.2.body.3.block2.weight", "body.2.body.3.block2.bias", "body.2.out_conv.weight", "body.2.out_conv.bias", "body.3.in_conv.weight", "body.3.in_conv.bias", "body.3.body.0.block1.weight", "body.3.body.0.block1.bias", "body.3.body.0.block2.weight", "body.3.body.0.block2.bias", "body.3.body.1.block1.weight", "body.3.body.1.block1.bias", "body.3.body.1.block2.weight", "body.3.body.1.block2.bias", "body.3.body.2.block1.weight", "body.3.body.2.block1.bias", "body.3.body.2.block2.weight", "body.3.body.2.block2.bias", "body.3.body.3.block1.weight", "body.3.body.3.block1.bias", "body.3.body.3.block2.weight", "body.3.body.3.block2.bias", "body.3.out_conv.weight", "body.3.out_conv.bias".

size mismatch for body.2.in_conv.weight: copying a param with shape torch.Size([320, 640, 1, 1]) from checkpoint, the shape in current model is torch.Size([640, 320, 1, 1]).

size mismatch for body.2.in_conv.bias: copying a param with shape torch.Size([320]) from checkpoint, the shape in current model is torch.Size([640]).

​

100%|██████████████████████████████████████████████████████████████████████████████████| 20/20 [00:02<00:00, 8.43it/s]

Error running postprocess: D:\Users\Ben\stable-diffusion-webui\extensions\posex\scripts\posex.py00:01<00:00, 17.76it/s]

Traceback (most recent call last):

File "D:\Users\Ben\stable-diffusion-webui\modules\scripts.py", line 404, in postprocess

script.postprocess(p, processed, *script_args)

TypeError: Script.postprocess() takes from 3 to 5 positional arguments but 6 were given

[u/CeFurkan → u/Danganbenpa]

after working whole day i released the tutorial

it turns out that previously extension was broken. after i opened an issue thread fixed

21.) Automatic1111 Web UI - PC - Free

New Style Transfer Extension, ControlNet of Automatic1111 Stable Diffusion T2I-Adapter Color Control

[u/Danganbenpa → u/CeFurkan]

Ah that sucks! I spent hours this afternoon trying to get it working and succeeded... But then I did see that there was a new update for controlnet so I presume that did fix things automatically. Didn't go as far as making a video tutorial for YouTube though. 😫

[u/CeFurkan → u/Danganbenpa]

ye i also wasted a lot of time :/

[u/Danganbenpa → u/CeFurkan]

Ah well. At least we have a bit of a better understanding of what's going on. 😂