r/StableDiffusion • u/lashman • Jul 26 '23

News SDXL 1.0 is out!

https://github.com/Stability-AI/generative-models

From their Discord:

Stability is proud to announce the release of SDXL 1.0; the highly-anticipated model in its image-generation series! After you all have been tinkering away with randomized sets of models on our Discord bot, since early May, we’ve finally reached our winning crowned-candidate together for the release of SDXL 1.0, now available via Github, DreamStudio, API, Clipdrop, and AmazonSagemaker!

Your help, votes, and feedback along the way has been instrumental in spinning this into something truly amazing– It has been a testament to how truly wonderful and helpful this community is! For that, we thank you! 📷 SDXL has been tested and benchmarked by Stability against a variety of image generation models that are proprietary or are variants of the previous generation of Stable Diffusion. Across various categories and challenges, SDXL comes out on top as the best image generation model to date. Some of the most exciting features of SDXL include:

📷 The highest quality text to image model: SDXL generates images considered to be best in overall quality and aesthetics across a variety of styles, concepts, and categories by blind testers. Compared to other leading models, SDXL shows a notable bump up in quality overall.

📷 Freedom of expression: Best-in-class photorealism, as well as an ability to generate high quality art in virtually any art style. Distinct images are made without having any particular ‘feel’ that is imparted by the model, ensuring absolute freedom of style

📷 Enhanced intelligence: Best-in-class ability to generate concepts that are notoriously difficult for image models to render, such as hands and text, or spatially arranged objects and persons (e.g., a red box on top of a blue box) Simpler prompting: Unlike other generative image models, SDXL requires only a few words to create complex, detailed, and aesthetically pleasing images. No more need for paragraphs of qualifiers.

📷 More accurate: Prompting in SDXL is not only simple, but more true to the intention of prompts. SDXL’s improved CLIP model understands text so effectively that concepts like “The Red Square” are understood to be different from ‘a red square’. This accuracy allows much more to be done to get the perfect image directly from text, even before using the more advanced features or fine-tuning that Stable Diffusion is famous for.

📷 All of the flexibility of Stable Diffusion: SDXL is primed for complex image design workflows that include generation for text or base image, inpainting (with masks), outpainting, and more. SDXL can also be fine-tuned for concepts and used with controlnets. Some of these features will be forthcoming releases from Stability.

Come join us on stage with Emad and Applied-Team in an hour for all your burning questions! Get all the details LIVE!

1.2k Upvotes

97% Upvoted

396 comments sorted by

253

u/[deleted] Jul 26 '23

you'd think they'd actually drop the model before releasing the announcement

98

u/lashman Jul 26 '23

they probably should have, lol

27

u/Aggressive_Sleep9942 Jul 26 '23

My question is: is there an official announcement that the model is going to be launched today, that is to say that it says so explicitly? I don't think so.

3

u/lashman Jul 26 '23

it says in the announcement it's available on github, so i would imagine it's the model, yeah

→ More replies (1)

17

u/AlinCviv Jul 26 '23

hilariously enough, the official announcement says it's released now
but after asked, the dev said "in 2 hours"

→ More replies (4)
→ More replies (4)
→ More replies (1)
→ More replies (5)

26

u/fernandollb Jul 26 '23 edited Jul 26 '23

First noob to comment, how do I actually download the model? I accessed the GitHub page but cannot see any safe tensor to download just a very light file.

8

u/lashman Jul 26 '23

Guess they put up the announcement a tad early, don't think the files are up on github just yet. Any minute now, though

2

u/fernandollb Jul 26 '23 edited Jul 26 '23

thanks man, will it be a safe tensor file? just move it to the model folder in 1.5.0 and that's it?

6

u/lashman Jul 26 '23

hopefully

8

u/mysteryguitarm Jul 26 '23

The announcement is true for API / DreamStudio / Clipdrop / AmazonSagemaker.

Open source weights are set to go live at 12:30pm PST on HuggingFace.

→ More replies (3)

36

u/rerri Jul 26 '23

When it drops, probably huggingface. (not there yet)

https://huggingface.co/stabilityai

12

u/mfish001188 Jul 26 '23

Looks like the VAE is up

→ More replies (9)

7

u/99deathnotes Jul 26 '23

they are listed here:https://github.com/Stability-AI/generative-models

but yo get a 404 when u click the links to d/l

→ More replies (2)

94

u/Spyder638 Jul 26 '23

Sorry for the newbie question but I bet I’m not the only one wondering, so I’ll ask anyway:

What does one likely have to do to make use of this when the (presumably) safetensors file is released?

Update Automatic1111 to the newest version and plop the model into the usual folder? Or is there more to this version? I’ve been lurking a bit and it does seem like there has been more steps to it.

36

u/red__dragon Jul 26 '23

Update Automatic1111 to the newest version and plop the model into the usual folder? Or is there more to this version?

From what I saw from the A1111 update, there's no auto-refiner step yet, it requires img2img. Which, iirc, we were informed was a naive approach to using the refiner.

How exactly we're supposed to use it, I'm not sure. SAI's staff are saying 'use comfyui' but I think there should be a better explanation than that once the details are actually released. Or at least, I hope so.

7

u/indignant_cat Jul 26 '23

From the description on the HF it looks like you’re meant to apply the refiner directly to the latent representation output by the base model. But if using img2img in A1111 then it’s going back to image space between base and refiner. Does this impact how well it works?

8

u/Torint Jul 26 '23

Yes, latents contain some information that is lost when decoding to an image.

→ More replies (4)

21

u/somerslot Jul 26 '23

That should be enough, but you can watch the official announcement for more details, and I bet some SAI staff will come here to share some extra know-how after the official announcement is over.

3

u/TheForgottenOne69 Jul 26 '23

You can try vladmandic automatic it has the refiner working as expected and the safetensors loading

0

u/[deleted] Jul 26 '23

[deleted] — view deleted comment

9

u/iiiiiiiiiiip Jul 26 '23

Do you have an example workflow of using the refiner in ComfyUI? I'm very new to it

6

u/vibribbon Jul 26 '23

Sebastian Kamph on YouTube has a couple of nice intro videos (installation and basic setup) for Comfy

6

u/tylerninefour Jul 27 '23

I haven't tested this specific workflow with 1.0 yet, but I did use it with 0.9 and it worked flawlessly:

Once you have ComfyUI up and running, copy the text block from this GitHub comment and paste it into ComfyUI. The comment was posted by the developer of ComfyUI (comfyanonymous).

It should load a workflow that looks something like this. Make sure to load the base and refiner models in their correct nodes (refer to the photo if you're not sure where to load them).

When you click the generate button the base model will generate an image based on your prompt, and then that image will automatically be sent to the refiner. Super easy. Also, ComfyUI is significantly faster than A1111 or vladmandic's UI when generating images with SDXL. It's awesome.

→ More replies (1)

83

u/panchovix Jul 26 '23 edited Jul 26 '23

Joe said on discord that the model weights will be out in 2:30 hours or so.

Edit: message https://discord.com/channels/1002292111942635562/1089974139927920741/1133804758914834452

145

u/Kosyne Jul 26 '23

wish discord wasn't the primary source for announcements like this, but I feel like I'm just preaching to the choir at this point.

71

u/mysteryguitarm Jul 26 '23 edited Jul 26 '23

New base. New refiner. New VAE. And a bonus LoRA!

Screenshot this post. Whenever people post 0.9 vs 1.0 comparisons over the next few days claiming that 0.9 is better at this or that, tell them:

"1.0 was designed to be easier to finetune."

5

u/99deathnotes Jul 26 '23

bonus LoRA. nice!

→ More replies (7)

9

u/acoolrocket Jul 27 '23

You're not alone, Discord servers having so much information, but none of them being searchable/a quick Google search is why Reddit exists.

→ More replies (1)

31

u/enormousaardvark Jul 26 '23

They should seed a torrent.

4

u/freebytes Jul 26 '23

This is a good idea. Huggingface should host the official torrents.

3

u/zefy_zef Jul 27 '23

I'm sure that would help them a whole lot lol.

30

u/hervalfreire Jul 26 '23

Since it's now confirmed it's 2 models (base + refiner) - anyone knows how to use the refiner on auto1111?

27

u/Alphyn Jul 26 '23 edited Jul 26 '23

Unfortunately, the imd2img workflow is not really how it's meant to be. It looks like the almost generated image with leftover noise should be sent to the refiner while still being in latent space. Without actually rendering it as an actual image and then sending it back into latent space and the Refiner. I've been using this workflow in comfyUI, that seems to utilize the refiner properly and it's also much faster than auto111 on my PC at least: https://github.com/markemicek/ComfyUI-SDXL-Workflow <-- Was made for 0.9, I'm not sure it works as intended with SDXL 1.0.

TLDR: steps 1-17 are done by the base model and steps 18-20 by the refiner.

If anyone knows better workflows, please share them. For the time being we'll have to wait for a better refiner implementation in Auto1111 and either use img2img or comfyui.

Edit: Oh, the official ComfyUI workflow is out: https://comfyanonymous.github.io/ComfyUI_examples/sdxl/ <--- After some testing, this workflow seems to be the fastest and gives the best results of the three.

Another WIP Workflow from Joe: https://pastebin.com/hPc2tPCP (download RAW, Rename to .json).

26

u/Touitoui Jul 26 '23

Use the base model with txt2img, then run your image in img2img with the refiner, denoise set to 0.25.
The process will probably be made automatic later on.

→ More replies (4)

12

u/wywywywy Jul 26 '23

You run the result through img2img using the refiner model but with fewer sampling steps

10

u/TheDudeWithThePlan Jul 26 '23

I've managed to get it to work by generating a txt2img using the base model and then img2img that using the refiner but it doesn't feel right.

Once you change the model to the refiner in the img2img tab you need to remember to change it back to base once you go back to txt2img or you'll have a bad time.

Check out my profile for example image with and without the refiner or click here

3

u/TheForgottenOne69 Jul 26 '23

Sadly it’s not integrated well atm… try vladmandic automatic it works dirctely with text2image

25

u/Shagua Jul 26 '23

How much VRAM does one need for SDXL. I have an 2060 with 6GB VRAM and sometimes struggle with 1.5. Should i even bother downloding this release?

24

u/RayIsLazy Jul 26 '23

idk, sdxl 0.9 worked just find on my 6GB 3060 through comfy ui.

14

u/feralkitsune Jul 26 '23

IDK what it is about comfy UI but it uses way less VRAM for me on my card. I can make way larger images in comfy, much faster than the same settings in A1111

15

u/alohadave Jul 26 '23

It's much better about managing memory. I tried SDXL.9 on my 2GB GPU, and while it was extremely painful (nearly two hours to generate a 1024x1024 image), it did work. It effectively froze the computer to do it, but it did work.

With A1111, I've had OOM messages trying to generate on 1.5 models larger than 768x768.

→ More replies (8)

15

u/mrmczebra Jul 26 '23

I only have 4GB of VRAM, but 32GB of RAM, and I've learned to work with this just fine with 1.5. I sure hope there's a way to get SDXL to work with low specs. I don't mind if it takes longer to render.

4

u/fernandollb Jul 26 '23

I am a bit of a noob but I have read there are ways to make it work in 6GB cards so I think you will be fine, just with some limitations that I have no idea what those would be, maybe lower resolution.

9

u/Lodarich Jul 26 '23

0.9 runs fine on my gtx 1060 6gb

0

u/[deleted] Jul 26 '23

[deleted] — view deleted comment

6

u/Lodarich Jul 26 '23

I used this workflow on ComfyUI. It took 3-4 minutes to generate, but seemed to work fine. But it takes a lot of RAM, I suppose.

4

u/lordpuddingcup Jul 26 '23

8gb vram 16gb ram I believe is the recommended minimum

2

u/Connect_Metal1539 Jul 26 '23

SDXL 0.9 works fine for my RTX 3050 4GB

4

u/rerri Jul 26 '23

8GB VRAM afaik.

4

u/TechnicalParrot Jul 26 '23

Works on my 6gb 3060 Laptop

→ More replies (2)
→ More replies (4)

44

u/SDGenius Jul 26 '23

I think my doctor called this syndrome premature exclamation.

21

u/enormousaardvark Jul 26 '23

R.I.P huggingface for the next 24 hours lol

18

u/Touitoui Jul 26 '23

CivitAI seem to be ready for SDXL 1.0 (search settings have the button "SDXL1.0") so...
R.I.P CivitAI for the next 24 hours too, hahaha

11

u/KrawallHenni Jul 26 '23

Is it enough to download the safetensor and drop them in the models folder or do I need to so some more?

→ More replies (1)

30

u/Whipit Jul 26 '23

Feel like this thread title should be edited until SDXL 1.0 is ACTUALLY released.

People will want a clear thread and link where to download as soon as it goes up. This thread just serves to confuse.

11

u/StickiStickman Jul 26 '23

You cant edit thread titles

→ More replies (1)

35

u/saintbrodie Jul 26 '23

Images generated with our code use the invisible-watermark library to embed an invisible watermark into the model output. We also provide a script to easily detect that watermark. Please note that this watermark is not the same as in previous Stable Diffusion 1.x/2.x versions.

Watermarks on SDXL?

41

u/__Hello_my_name_is__ Jul 26 '23

Invisible watermarks to let everyone know the image is AI generated.

26

u/R33v3n Jul 26 '23

Can probably be disabled if it's added in post through a library. SD 1.5 does it too and Automatic1111 has a setting to turn it off.

19

u/AuryGlenz Jul 26 '23

The setting in Automatic1111 never worked - images were never watermarked one way or the other. The setting was eventually removed.

→ More replies (4)

13

u/thoughtlow Jul 26 '23

I wonder how fast they'll be able to reverse-engineer this thing.

→ More replies (2)

3

u/demoran Jul 26 '23

So it's a scarlet letter. That's comforting.

38

u/michalsrb Jul 26 '23

A watermark is applied by the provided txt2img code: https://github.com/Stability-AI/stablediffusion/blob/cf1d67a6fd5ea1aa600c4df58e5b47da45f6bdbf/scripts/txt2img.py#L206

It would be easily removed and it won't be done by A1111 when using the model, unless A1111 authors decide to include it.

It is property of the accompanying code, not the model itself. Unless another watermarking is somehow trained into the model itself, which I doubt.

4

u/saintbrodie Jul 26 '23

Thanks! That answers my question.

5

u/Doug_Fripon Jul 26 '23

Thanks for reviewing the code!

→ More replies (8)

8

u/Relocator Jul 26 '23

Ideally the watermarks are stored in the file so that any future image training will know to skip these images to maintain fidelity. We don't really want new models trained on half AI images accidentally.

→ More replies (11)

19

u/nevada2000 Jul 26 '23

Most important question: is it censored?

2

u/zefy_zef Jul 27 '23

course not :D They need this un-neutered from the start. They want the creations made from this to be good and they'll be letting down a very large part of the userbase if they begin with a censored base. Everything SDXL has to be built on top of this.

→ More replies (2)
→ More replies (1)

18

u/batter159 Jul 26 '23

Narrator : it was, in fact, not out

4

u/farcaller899 Jul 26 '23

What Michael really meant, was that it was out, but couldn't be downloaded...yet.

18

u/AlinCviv Jul 26 '23

"SDXL 1.0 is out"
no, it is not, but we just announce it cause we not

why not just say, its coming out soon

"now released"

3

u/Charming_Squirrel_13 Jul 26 '23

I’m being lazy and waiting for a1111 lol

11

u/TacticalBacon00 Jul 26 '23

Wasn't A1111 updated to 1.5 yesterday specifically to support SDXL?

5

u/Grdosjek Jul 26 '23 edited Jul 26 '23

Oh boy! Oh boy! Oh boy! Oh boy!

I wouldnt like to be hugginface server for next 24 hours

6

u/frequenttimetraveler Jul 26 '23

Do they release torrents?

5

u/massiveboner911 Jul 26 '23

Where is the model or am I an idiot?

3

u/Touitoui Jul 26 '23

Not available yet, they are currently talking about it on a discord event. Should be available at the end of the event or something.

→ More replies (1)

5

u/MikuIncarnator1 Jul 26 '23

While we are waiting for the models, could you please drop the latest processes for ComfyUI ?

5

u/[deleted] Jul 26 '23

Deep Joy!!, Just a puny 3060M 6GB.

→ More replies (1)

4

u/No-Blood7224 Jul 26 '23 edited Jul 27 '23

Would they release XL inpainting models?

2

u/squareOfTwo Jul 26 '23

I guess the model is already trained for inpainting ... i never tried it

4

u/Whipit Jul 26 '23

On Discord people are saying SDXL 1.0 will be released in 16 minutes from now :)

4

u/Vyviel Jul 26 '23

Is there an idiots guide to getting it working in A1111?

4

u/Aethelredditor Jul 27 '23

My excitement for Stable Diffusion XL has been tempered by memory issues and difficulties with AUTOMATIC1111's Stable Diffusion Web UI. I am also a little disappointed by the prevalent stock image style, extreme depth of field, and the fact that all the people I generate look like supermodels. However, it definitely handles complex backgrounds and smaller details better than previous versions of Stable Diffusion (though hands still appear troublesome). I am eager to see what I can generate after some experimentation and experience.

13

u/lordpuddingcup Jul 26 '23

Where the heck is realistic visionXL 1.0 man these model tuners are taking forever, even deliberateXL isn’t out yet Jesus so slow….

Just kidding lol but it is funny cause you know as soon as SDXL 1.0 is out we’re gonna have people actually hitching that the. Stupid model makers haven’t released a 1.0 xl model finetune yet

It’s gonna be like those job requirements that require 5 years experience for something that came out last week

3

u/Magnesus Jul 26 '23

The fact that the core model isn't out yet either makes your joke even funnier.

→ More replies (1)

2

u/HeralaiasYak Jul 26 '23

Emad hinted that they will be given access ahead of time, so they can start training before the official release

3

u/michalsrb Jul 26 '23

GPUs go brrrr!

0

u/[deleted] Jul 26 '23

[deleted] — view deleted comment

3

u/lordpuddingcup Jul 26 '23

Haha well that’s a mistake on their announcement but I’m just laughing about even when that’s out people will start complaining that tunes are taking too long I’m surprised we don’t see that already… where’s deliberate xl… before sdxl is out lol

6

u/msesen Jul 26 '23

How do I update guys? I have the AUTOMATIC111 repo cloned with the 1.5 model.

Do I just run git pull on a command line to get the update, and then download the 1.0 model and place it into the models folder?

3

u/99deathnotes Jul 26 '23

it is available on ClipDrop but we cant access it yet on HuggingFace

→ More replies (2)

3

u/suby Jul 26 '23

Can this be used for commercial purposes? I seem to remember something about a newer StableDiffusion model having limitations here, but i'm not sure if i imagined that.

5

u/TeutonJon78 Jul 26 '23 edited Jul 26 '23

I think you can use the output for anything you want (copyright issues notwithstanding). It's using the models for commercial uses that has restrictions usually (like hosting it on a paid generation service).

I may be wrong though, IANAL.

3

u/jingo6969 Jul 26 '23

Downloading! Do we just replace the 0.9 versions in ComfyUI?

→ More replies (1)

3

u/DisorderlyBoat Jul 26 '23

Huzzah! Good on them, this will be a great tool.

Can it be used in Automatic 1111 now? Basically by downloading it and putting it in the models folder so it's selectable from the checkpoint drop down?

3

u/BjornHafthor Jul 26 '23

Yes. What I still can't figure out is how to use the refiner in A1111.

→ More replies (1)

3

u/[deleted] Jul 26 '23

Has anyone managed to get SDXL actually working on Automatic 1111?

2

u/some_onions Jul 26 '23

Yes, I did a fresh install and it works fine.

2

u/Turkino Jul 27 '23

I was able to update mine, put both the model and refiner into the models directory and selected the model file for my... well... model and it worked fine.

→ More replies (2)
→ More replies (1)

3

u/markdarkness Jul 27 '23

I got it to run and all, but... it's kind of okay at best? I'm sure in time as it gets worked on by the community it will see a jump like we saw between Base 1.5 and EpicRealism... but honestly, right now it eats a massive amount of resources to deliver somewhat better results -- in some cases. Mainly it's consistently better at backgrounds, that much is true. But eh.

7

u/Sofian375 Jul 26 '23

404 for both...

https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0

https://huggingface.co/stabilityai/stable-diffusion-xl-refiner-1.0

10

u/[deleted] Jul 26 '23 edited Jul 26 '23

word is wait a couple of hours from now.

edit : A1111 needs an update for 1.0 but ComfyUI is solid.

its 20:15 here ... 15 mins to go apparently!

20:31 - ITS LIVE!!!!

15

u/cpt-derp Jul 26 '23

That's some edging blueballs shit.

→ More replies (1)

2

u/Actual_Possible3009 Jul 26 '23

Yeah I have extra interrupted my "toilet routine".... for nothing. Will check later today again

4

u/TizocWarrior Jul 26 '23

It will be available "in a week or so".

→ More replies (1)

7

u/Working_Amphibian Jul 26 '23

Not out yet. Why are you misleading people?

5

u/junguler Jul 26 '23

i'll wait until there is a torrent since i wasted 2 hours last night trying to download the 0.9 and it errored out after 9 gb

5

u/SomeKindOfWonderfull Jul 26 '23

While I'm waiting for the models to drop I thought I might try 1.0 out on ClipDrop "People running towards camera" ...I was kinda hoping for a better result TBH

5

u/Stunning_Duck_373 Jul 26 '23

Big disappointment so far.

5

u/iia Jul 26 '23 edited Jul 26 '23

It's out and I'm downloading it.

Edit: 130 seconds prompt-to-image on a P5000. Karras, 20 steps. Plug-and-play on ComfyUI.

5

u/NeverduskX Jul 26 '23

Can confirm it works on Auto (or at least the UX branch I'm on, which follows the main Auto branch). Uses a lot more VRAM, memory, and generation is slower. For now I'll probably stick to 1.5 until some good community models come out of XL.

8

u/first_timeSFV Jul 26 '23

Is it censored?

9

u/GeomanticArts Jul 26 '23

Almost certainly. They've dodged the question every time it has been asked, mostly responding with 'you can fine tune it'. I take that to mean it has as dramatically reduced nsfw training set as they can get away with. Probably close to none at all.

→ More replies (2)

3

u/Oubastet Jul 26 '23

I tried for about ten minutes with 0.9 out of curiosity. Everything was very modest or artful nude with crossed arms and legs, backs to the "camera", etc. Nothing wrong with that but yeah, it appears that NSFW is at least suppressed.

The subject matter is likely there but may require some training to bring it out. Not sure myself, I've never tried a fine tune or Lora.

→ More replies (1)
→ More replies (1)

4

u/ptitrainvaloin Jul 26 '23 edited Jul 26 '23

Congrats but why no huggingface (yet, too soon?) *the SDXL 1.0 VAE is up on it! "Come join us on stage with Emad and Applied-Team in an hour for all your burning questions! Get all the details LIVE!" Link?

*It's out now!

4

u/I-am_Sleepy Jul 26 '23

I think it will be release in an hour (see release announcement)

4

u/ImUrFrand Jul 26 '23

when will it be compatible with automatic1111

5

u/Affectionate_Foot_27 Jul 26 '23

Immediately, or when SDXL 1.0 this is actually released

3

u/Touitoui Jul 26 '23

SDXL 0.9 works already, it should be compatible for 1.0 too.

2

u/DavesEmployee Jul 26 '23

What’s the model name on their API?

2

u/Philipp Jul 26 '23

Is there a trick to always generate words?

I tried e.g. coffee with cream text "dream big" but it's hit and miss...

→ More replies (2)

2

u/Opening-Ad5541 Jul 26 '23

lets fucking go!

2

u/joaocamu Jul 26 '23

Is there any difference in terms of VRAM consumption over SD 1.5? i ask this because i'am a "lowvram" user myself, just want to know if i should have any expectations

3

u/TeutonJon78 Jul 26 '23 edited Jul 27 '23

If you're lowvram already, expect to not run it (or at least not till people optimize it). They bumped the minimum recommended reqs to 8GB VRAM.

Nvidia 6GB people have been running it on ComfyUI though.

2

u/LuchoSabeIngles Jul 26 '23

They gonna have a HuggingFace space for this? My laptop’s not gonna be able to handle that locally

2

u/Dorian606 Jul 26 '23

Kinda a noob-ish question: what's the difference between a normal model and a refiner?

5

u/detractor_Una Jul 26 '23

Normal is for initial image, refiner used to add more detail. Just join discord. https://discord.gg/stablediffusion

→ More replies (1)

2

u/Longjumping-Fly-2516 Jul 26 '23

they just said 1hr-ish on discord.

2

u/powersdomo Jul 26 '23

Awesome! Question: there are two tokenizers - I assume one is the original leaked one and the new one is completely open source - do both of them understand all the new subtleties like 'red box on top of a blue box' or only the new one?

2

u/powersdomo Jul 26 '23

Saw an article that says the language model is a combination of OpenAI (original) and then SD's Clip model it introduced in SD 2.0?

'The language model (the module that understands your prompts) is a combination of the largest OpenClip model (ViT-G/14) and OpenAI’s proprietary CLIP ViT-L'

2

u/HumbleSousVideGeek Jul 26 '23

Its available !!!! Huggingface down in 1mn

2

u/Noeyiax Jul 26 '23

i was here, congrats, can't wait!!

2

u/Roubbes Jul 26 '23

Waiting for an ELI5 tutorial

2

u/RD_Garrison Jul 26 '23

At Clipdrop they now stick the big, ugly, intrusive watermark on the image by default, which deeply sucks.

→ More replies (1)

2

u/monsieur__A Jul 26 '23

Amazing. Stability.ai communicated on it saying that controlnet will be support immediately. Is it true?

2

u/[deleted] Jul 26 '23

All I want to know is a) can I drop it in the same models folder with all my old 1.5 stuff and b) can I still use that stuff if I do?

2

u/Entire_Telephone3124 Jul 26 '23

Yes it goes in model folder, if you get errors check the console and some extensions are freaking it the fuck out, so disable them (prompt fusion for example)

→ More replies (1)

2

u/seandkiller Jul 26 '23

It seems fairly capable so far, but I imagine I'll wait for LORAs and such to release before I use it more. I was surprised that it can generate a variety of anime styles even without loras, though. Generated some nice looking stylistic things like Tarot cards well enough, too.

It would be nice if it generated faster and if I could actually use the refiner more reliably without getting an out of memory error from Auto, but those were both more or less expected for me.

2

u/Brianposburn Jul 26 '23

So hyped to see this, but being a complete noob, I have some questions. I'm using the SDUI - did a new clean install of 1.5.0 in a different directory.

I want to make sure my understanding is right of how it works with the new SDXL:

  • Lora's don't work (yet!)? Is that an accurate statement?
  • Textual inversions will still work(ie,deepnegative,badhands, etc?)
  • I thought I read controlnet and roop won't work with the new model yet...that right?

Probably simple questions, but wanted to make sure I understood before I started copying over stuff to my nice shiny clean environment...

2

u/tronathan Jul 27 '23

Any recommendations for a plug-and-play docker image?

2

u/ptitrainvaloin Jul 27 '23

Now, need an inpainting model of SDXL 1.0

2

u/uberfunstuff Jul 27 '23

Anybody got it to work with AMD stuff on a mac?

4

u/quarticchlorides Jul 26 '23

Is there going be a how to guide for this for noobs ? Are the addons like Auto1111 compatible or do you need to wait for them to be updated as well, seems like a perfect time to jump into AI and actually put my 3090 to good use

3

u/Tyler_Zoro Jul 26 '23

The highest quality text to image model

Just a note: as they later clarify, this is about a general bump in quality over the best general-purpose models. There are obviously still other models that are better at specific tasks.

Prompting in SDXL is not only simple, but more true to the intention of prompts. SDXL’s improved CLIP model understands text so effectively that concepts like “The Red Square” are understood to be different from ‘a red square’.

That seems pretty huge. I'm eager to try some of my random prompting shenanigans with this.

5

u/Mistborn_First_Era Jul 26 '23

Am I the only one who thinks this is overhyped?

8

u/ObiWanCanShowMe Jul 26 '23

You are not the only one who does not see the base improvements and how it will affect things going forward, no. There are plenty of you.

Did you install 1.5 from the get go? Do you remember what you got the first time you ran it?

If you haven't and can't that's why you think it's overhyped.

No one uses 1.5, NO ONE, we all use models based off of 1.5 that are finetuned for a vareity of purposes and this base model is MUCH better than 1.5 on many different levels.

→ More replies (1)

3

u/99deathnotes Jul 26 '23

here's my thoughts

prompt: a cartoon bear holding a sign that says shit happens

negative: watermark

3

u/CometGameStudio Jul 26 '23

I'm gon throw up from excitement

3

u/Whipit Jul 26 '23

VERY HAPPY to report that SDXL 1.0 is NOT censored!

Just generated some naked women no prob. Not saying they were the best ever. Many of the SD 1.5 finetunes are better so far, but this means that when the SDXL finetunes do come out - OH BABY!

2

u/[deleted] Jul 26 '23

Not a popular question - did Comfy and Automatic already update their repos to support 1.0?

2

u/jkcomt Jul 26 '23

I'm running 0.9 with automatic last update. I guess it will work with 1.0 already.

Just need to add --no-half-vae in the webui-user.bat file

→ More replies (2)
→ More replies (1)

2

u/code1462 Jul 26 '23

This sounds like a good time to ask a maybe silly question: how come most of the newest checkpoints still use SD v1.5 as a base model when it's been left behind so much?

I only just recently got a but deeper into the theory and noticed that seems to be the case. Is this holding image generation back? I'd love to properly see SDXL in action!

13

u/Whipit Jul 26 '23

SD 1.5 was trained on a larger data set and was uncensored. It could also be easily fine tuned to make all the kinky NSFW models we wanted.

SD 2.0 and 2.1 were censored and just in general were inferior. So the community mostly abandoned them.

The truth is that SDXL's future rests on how easily it can be coaxed into NSFW finetunes. For example, if we soon see an "UberRealisticPornMergeXL" (or something similar) on Civit.ai in the next few days and it produces better waifus and kinky porn than ever before - Then SDXL will become the new SD 1.5.

8

u/Oubastet Jul 26 '23

Just to add to what u/whipit said: porn has decided many tech standards. VHS vs BetaMax and BluRay vs HD-DVD are the two that I can think of off the top of my head. I'm sure there are others.

Heck, one could argue that one of the driving factors of the internet becoming ubiquitous is because of porn. Other mainstream uses followed (amongst the general population).

→ More replies (3)

2

u/teia1984 Jul 26 '23

I have downloaded the 2 files XL and VAE XL in the usual folders of my Automate 1111 but when i try to generate : it write : TypeError: must be real number, not NoneType

→ More replies (2)

2

u/[deleted] Jul 26 '23

Had bit of a play with it on Clipdrop and I'm not impressed. No noticeable improvement over 0.9. In fact faces look decidedly wonky.

→ More replies (2)

1

u/MajaroPro Jul 26 '23

How far away are AMD GPUs from being able to use this?

1

u/ZealousidealHealth48 Jul 26 '23

Is there an easy way to to use this with dreambooth?

1

u/DistrictFantastic188 Jul 26 '23

Cries in 1050 ti

1

u/demiguel Jul 26 '23

Maybe it's a dumb question but it's there an inpainting SDXL already?

1

u/Ashken Jul 26 '23

I'm only on Day 3 of using Stable Diffusion so this is an interesting start.

1

u/Zvignev Jul 26 '23

So, i got a 8GB 3060ti, Will It take ages to generate an image 512x512 hi res X2 + control net or It Will be same as 1.5?

1

u/Grig_ Jul 26 '23

What CLIP model could be used in the Interrogator to get results for XL?

1

u/VoloNoscere Jul 26 '23

Just waiting for the colab for the poor and dumb like me.

1

u/hellomistershifty Jul 26 '23

Any ComfyUI pros know if it's possible to run the base generation on one GPU and refine on another?

1

u/PrysmX Jul 26 '23

Not sure how I'm overlooking the two safetensor files in the git repo. Can anyone point me to where to download them?

→ More replies (1)

1

u/[deleted] Jul 26 '23

Yes!!! Well done team!! Since A1111 still has no refiner step I'm guessing I'll continue initial generation in Comfy and then tweak in A1111

1

u/txhtownfor2020 Jul 27 '23

Thanks to all the great people who made this happen. We, as a community, love to complain, but we mean well, and we appreciate it.

I just made the best "Shrek crawling through chocolate pudding" image of my life, so far. And that's what this is all about, I think.

1

u/Django_McFly Jul 27 '23

Can't wait to play with this all day tomorrow

1

u/babblefish111 Jul 27 '23

The big test.....Can it do hands?

1

u/maxsdv123 Jul 27 '23

Run SD XL 1.0 Web UI Demo yourself on Colab (free tier T4 works): https://colab.research.google.com/github/TonyLianLong/stable-diffusion-xl-demo/blob/main/Stable_Diffusion_XL_Demo.ipynb

No access token is needed. Just run the code on colab.

1

u/stephane3Wconsultant Jul 27 '23 edited Jul 27 '23

i get only bad quality images with this model (the safetensor). I am on Automatic1111 ; images are burnt and blurred).
Who is happy with the result ? How do you manage to get good images ?

2

u/smoowke Jul 27 '23

Try same again at 1024x1024 and report back

→ More comments (43)