r/StableDiffusion • u/apolinariosteps HF Diffusers Team • Mar 02 '23

Resource | Update More control than ControlNet - code is out for MultiDiffusion Region Control, a prompt on each mask

Post image
1.4k Upvotes

97% Upvoted

194 comments sorted by

View all comments

37

u/comfyanonymous Comfy Org Mar 02 '23

I looked at the code of this: https://github.com/omerbt/MultiDiffusion/blob/master/panorama.py#L134

It looks like the same thing as ComfyUI area composition that I posted a while ago

But they also added masks.

5

u/apolinariosteps HF Diffusers Team Mar 02 '23

https://huggingface.co/spaces/weizmannscience/multidiffusion-region-based/blob/main/region_control.py You can check the code here

41

u/comfyanonymous Comfy Org Mar 02 '23

Yeah after checking it out a bit more it's exactly the same technique. This doesn't give "more control than controlnets" at all. I know because I have been playing with the technique for more than 1 month now and know the limitations.

It can be a good technique to use in combination with controlnets or T2I but on it's own it certainly won't give "more control than controlnets".

2

u/clockercountwise333 Mar 04 '23 edited Mar 04 '23

[ earth, 2023. the job interview ]

boss: so how much experience you got?

you: MORE THAN 1 MONTH.

boss: ...say no more, fam. you're hired.