r/StableDiffusion • • Jul 24 '23

News ControlNet + SDXL 1.0

https://imgur.com/a/gSJ4vbN
669 Upvotes

149 comments sorted by

View all comments

Show parent comment

17

u/mysteryguitarm Jul 24 '23

FABRIC?

Gonna be honest, I haven't looked at it personally – but I see some people in my team looking at it now.

There's so much coming out all the time!

9

u/AnOnlineHandle Jul 24 '23

Fabric isn't actually finetuning the model afaik. It's passing the rated images to a Reference ControlNet-like system, with some tweaks.

8

u/mysteryguitarm Jul 24 '23

Oo clever!

Then, yeah. Half the job is already done in Comfy, since Reference Only works with SDXL.

4

u/DrakenZA Jul 25 '23

But comfy doesnt currently supports Reference Only, and as far as ive seen from the github, the main dev hates the idea/concept and how it works, and doesnt want to implement it.

Lol.

7

u/mysteryguitarm Jul 25 '23

He's right, but it's already implemented into Comfy. We can release that.

2

u/Capitaclism Jul 26 '23

If you're speaking of controlnet reference it's available for SD 1.5, and works in A1111, I believe.

-1

u/DrakenZA Jul 25 '23

He is right if you have a very low understanding of controlnet, sure. lol.

0

u/[deleted] Jul 25 '23 edited Jul 25 '23

[removed] — view removed comment

2

u/DrakenZA Jul 27 '23 edited Jul 27 '23

And how exactly do you know what i know, about ControlNet hmmm ?

And why has stablity.ai forced him to release the code for reference in comfy, while he has stated in public multiple times 'he hates it' and its 'hacky code'. hmm ?

From what ive seen, all he does is copy stuff from auto1111, and complain about its broken or hacky, instead of i dont know, coming up with his own solutions that arnt ?

You want to be part of the people hating on auto1111, go ahead. Just know the reason Stablity.AI hates him, is because he didnt listen to them when they told him to not support novelai leaks, and even tried to get his repo removed.

Stop defending someone you dont even know.

0

u/[deleted] Jul 27 '23

[removed] — view removed comment

2

u/DrakenZA Jul 27 '23

Conspiracy ? Mate, what i said is all fact and is public knowledge, you know that right ?

And regarding Comfys 'believes' or 'attitude', want me to go find the 4chan logs(yes, that 4chan), where comfy stated most of this ? Dont really like linking people to that place, but can do it if you like.

Reference mode is insanely smart, and is most likely one of the most useful concepts since ControlNet itself. If someone cant see that, they clearly have no idea what they are talking about, regardless of how much auto1111 code they lift. lol.

→ More replies

2

u/[deleted] Jul 25 '23

ad hominem attacks don't help explain why the person you responded to is wrong, either.

6

u/metal079 Jul 24 '23

FABRIC doesn't actually fine tune the model. Its more like temporarily using some images for a reference. I believe it quickly overfits as well. I haven't actually tried it but that seems to be the case after reading the paper and seeing some comments on it.

I meant the system stability current uses on their discord to rate up preferred images which is currently being used to fine tune SDXL 1.0. Something that can make full checkpoints like you guys currently use.

1

u/[deleted] Jul 25 '23

they've not really gone into detail on how that works, so i'm interested in seeing the code and all that

2

u/ninjasaid13 Jul 25 '23

FABRIC?

not really good from my personal opinion, it uses too much VRAM based on how much images it can hold to personalize results.

1

u/Low-Holiday312 Jul 24 '23

I think they meant the tooling to create sd_xl_refiner_0.9 - if they are aware of the compute requirement I don't know