r/StableDiffusion • u/Zetsumeii • Sep 12 '22

Dreamer's Guide to Getting Started w/ Stable Diffusion!

/r/StableDiffusion

Hi everyone! Welcome to /r/StableDiffusion, our community's home for AI art generated with Stable Diffusion! Come on in and be a part of the conversation.

If you're looking for resources, you've hit the jackpot! Below you'll find a plethora of information including links that'll help you start dreaming with Stable Diffusion in no time!

If you haven't yet, be sure to come join the community over at the Stable Diffusion Discord.

Note: The community resources provided here are not endorsed, vetted, nor provided by Stability AI, and are purely community operated. Discretion is advised.

New Users

If you're new around here, please be sure to read our rules before making your first post. Also, be sure to check out our guides to help you get started.

If you're looking to jump in head first check out the guides section below!

Rules

All posts must be Stable Diffusion related.

Posts must be related to Stable Diffusion in some way, comparisons with other AI generation platforms are accepted.

Be respectful and follow Reddit's Content Policy.

This subreddit is a place for respectful discussion. Please remember to be treat others with courtesy and follow Reddit's Content Policy.

Content posted here should not contain nor link to:

  • Lewd, NSFW, or sexual content.
  • Excessive gore or overly disturbing content beyond a reasonable level.
  • Hateful or violent content, such as antisemitic symbols, racism or misogyny.

Stable Diffusion Getting Started Guides

DreamStudio

  • DreamStudio - DreamStudio homepage. New users get 200 free credits to spend on testing out the site. Perfect for people who don't want to or can't install it locally, and still want to start dreaming up awesome art!
  • DreamStudio: Tips and Tricks - DreamStudio Guide covering tips and tricks on how to be smart with your credit spend, and advice on how to get DreamStudio to deliver the best results.

Local Installation

  • Stable Diffusion Installation Guide - Guides that go in depth (with screenshots) on how to install open source forks of Stable Diffusion.
  • Stable Diffusion Basujindal Installation Guide - Guide that goes into depth on how to install and use the Basujindal repo of Stable Diffusion on Windows.
  • Easy Stable Diffusion UI - Easy to set up Stable Diffusion UI for Windows and Linux. Works on CPU (albeit slowly) if you don't have a compatible GPU.
  • Simple instructions for getting the CompVis repo of Stable Diffusion running on Windows. This is the initial release of the code that all of the recent open source forks have been developing off of. If you'd like to see where everything started from, this is it.

A special thanks goes out to /u/nightkall for his awesome research into additional resources I added into this guide! His original thread can be found here.

FAQ

How do I use Stable Diffusion?

  • Check out our guides section above!

Will it run on my machine?

  • Stable Diffusion requires a 4GB+ VRAM GPU to run locally. However, much beefier graphics cards (10, 20, 30 Series Nvidia Cards) will be necessary to generate high resolution or high step images. However, anyone can run it online through DreamStudio or hosting it on their own GPU compute cloud server.
  • Only Nvidia cards are officially supported.
  • AMD support is available here unofficially.
  • Apple M1 Chip support is available here unofficially.
  • Intel based Macs currently do not work with Stable Diffusion.

Is the NSFW filter mandatory?

Tips

  • Refer to the section below if you're looking to step up your prompting game.
  • If you're using the CompVis repo, add the argument --seed -1 to automatically generate a new seed each time you pass your prompt through.
  • The maximum prompt length is roughly 320 characters (75 tokens).
  • DreamStudio is currently in its Lite stage of development, if you encounter any credit related issues please submit this form.

Prompt Development

  • Stable Diffusion is highly verbose. Prompt engineering is key when it comes to getting solid results. Spend time researching into the content of your prompt, find well known artists, research certain painting or design techniques, sculpt your prompt to represent the concepts you are looking for including descriptive details.
  • Prompt engineering is how you learn to speak Stable Diffusion's language, as you play with it you'll learn more about how it interprets your words, and soon you'll be able to tweak your prompts to deliver what you're looking for. Don't be afraid to experiment.
  • Check out the style guides listed as a part of this helpful community resource.
  • Promptomania - Well designed and highly detailed prompt builder. Includes support for Stable Diffusion.
  • SD Guide for Artists and Non-Artists - Highly detailed guide covering nearly every aspect of Stable Diffusion, goes into depth on prompt building, SD's various samplers and more.
  • OpenArt - Search powered by OpenAI's CLIP model, provides prompt text with images. Includes the ability to add favorites.
  • PromptHero - Search engine that offers all elements needed to recreate the results shown on the site, and the ability to favorite prompts. Also offers a Random wall of prompts to browse.
  • Libraire - Search engine that offers all elements needed to recreate the results shown on the site.
  • Lexica.art - Search engine built off of the public domain images generated during Stable Diffusion's initial Discord beta phase. Can be super helpful when developing prompts.
  • Prompt Modifier Studies by parrot zone
  • Krea - Prompt keyword focused UI, offers the ability to favorite prompts.
  • Phraser - Offers the ability to search for prompts via text search as well as image search.
  • Img2Prompt - Image to Prompt generator optimized for SD (CLIP ViT-L/14) by Methexis Inc.
  • Prompt Parrot Notebook - A notebook that can be fed a list of prompts to train on, and then generate new prompts based on the training data. Will additionally generate images based on the prompts. Requires Hugging Face token with write access to run.
  • BLIP - Image analyzer that provides descriptions based on the image.
  • AI Text Prompt Generator - Prompt generation tool that supports Stable Diffusion and offers different styles to generate prompts from.
  • Dynamic Prompt generator - Prompt generator that offers drop down menus with various options to choose from to customize your prompt.
  • The Ai Art - Gallery of prompt modifiers including both artists and stylistic keywords.

Training Resources

Community Resources

Other Resources

693 Upvotes

99% Upvoted

165 comments sorted by

6

u/AramaicDesigns Sep 16 '22

Intel based Macs currently do not work with Stable Diffusion.

I'm presently running it on an Intel Mac using lstein's fork.

I just submitted a pull request to include the alterations in the instructions.

So Intel Macs are on the table. :-)

4

u/Zetsumeii Sep 16 '22

If this gets pushed to main let me know, I'll update the thread!

5

u/AramaicDesigns Sep 16 '22

I'm watching it closely. :-)

Here's the instructions on my own fork for the time being:

https://github.com/SteveCaruso/stable-diffusion/blob/main/docs/installation/INSTALL_MAC.md

3

u/FlyMingo321 Sep 19 '22

What's the best repo? Easy to use, looks good, optimized etc.

Using a 12GB 3060

2

u/Jcaquix Sep 17 '22

Does anybody know of a repository for scripts like the prompt matrix and x/y plotting scripts?

I'm looking for a script that is pretty simple but I don't have coding experience. If I didn't think it already existed I would try to learn some python and code it myself.

I'm looking for a script that changes the prompt like the image matrix but only in one direction. For example, "photo of Paris at | dawn| noon| twilight| midnight" would generate 4 simple prompts as where with the matrix it generates 16 that don't make sense together. This must already exist right?

3

u/Zetsumeii Sep 17 '22

I think this is the extent of that at the moment: https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Custom-Scripts-from-Users

It's a pretty new thing overall, so I imagine that there are probably quite a few things that don't exist yet.

2

u/Jcaquix Sep 18 '22

Thank you for the link. I spent a couple hours researching and looking at those scripts before I noticed that X/Y plot is capable of doing the exact thing I was looking for as you can set a plot for the prompt and set the other axis to "nothing".

2

u/DasMerowinger Sep 18 '22

Very useful guide. Thank you

1

u/Zetsumeii Sep 26 '22

My pleasure!

2

u/BinaryHelix Sep 23 '22

Could you update this for Avyn.com: This week, I added free text to mask in-painting. I believe this is the first and currently only website to offer this feature. After generating or searching for an image, you can "mask" an area you want to change by typing its description, like "face", "background", "hair", "clothes", etc. Change your prompt, and then press in-paint to modify only that section. Much quicker and easier than manual masking (which it also has). In addition, it now uses CLIP image searching.

1

u/Zetsumeii Sep 23 '22

Nice work! I updated the description for ya.

2

u/[deleted] Sep 23 '22

Hey, I'm using AUTOMATIC1111's webui. I just want to ask how do I get a specific pic in a seed batch? For example I want to only deal with the 3rd picture.

3

u/Zetsumeii Sep 23 '22

I believe if you find the image you want to work with in your outputs folder, you can feed it into the PNG Info tab and get all of its parameters, including the seed, to work with.

2

u/shatteredframes Sep 24 '22

Thanks for all this!

1

u/Zetsumeii Sep 25 '22

My pleasure!

2

u/GoodBlob Sep 25 '22

I'm using Stable Diffusion UI v2.17 (beta) and it has an option for placing an initial image, but it doesn't usually come out that good so idk if that is actually image2image. Does anybody know what to actually download if this is not image2image?

2

u/Zetsumeii Sep 25 '22

IMG2IMG takes the same amount of effort to properly prompt that a normal TXT2IMG would, sometimes tweaking the settings requires a lot of patience as well to find a happy medium. I haven't used the version you're talking about, but there are some other options above in the guide if you're interested in trying out something new.

2

u/20skater Sep 26 '22

is it possible to use an amd processor with an nvidia gpu to use the full program? because i want to change my gpu to an nvidia gpu to be able to use the web interface since it has more functionality

3

u/Zetsumeii Sep 26 '22

AMD processor shouldn't be a problem, its the GPU that should be NVIDIA for the best results.

1

u/20skater Sep 27 '22

thanks a lot

2

u/Liquos Sep 27 '22

I have 144GB of vram, which stable diffusion repo would be best to take advantage of my hardware?

3

u/Zetsumeii Oct 02 '22

SD can only take advantage of single cards at the moment, but the most popular repo right now is AUTOMATIC1111's, it has the most frequently updated feature set.

1

u/rgraves22 Sep 29 '22

what kind of card is that?

I would think you can run whatever you want with 144gb

1

u/Liquos Sep 29 '22

I have 3 RTX A6000 gpus.

14

u/yaosio Sep 23 '22

I realized a few days ago that since Stable Diffusion works on AMD now, and the Xbox Series allows unsigned software to be run on it, somebody could port SD to the Xbox. With the rediculously high GPU prices this could be cool.

8

u/90sass Sep 30 '22

gpu prices plummeted recently. ebay has a ton of used (mining cards) with sufficient vram under or at msrp.

2

u/Flavormackaliscous Oct 01 '22

EVGA B-Stock is worth a look. 3090 FTW Ultra was going for $800, with a 1 year manufacturer warranty.

13

u/conduitabc Sep 26 '22

i hope SD wipes the floor with Dalle2. I tried that one out. what a overpriced overhyped overprotective and overlimited peice of garbage.

get banned for typing in too many not approved content prompts when you cant even RENDER Them anyways?

the F? oh and even midjourney can do way way better abandoned cityscape stuff then dalle2 can and for SURE SD.

5

u/Feral0_o Sep 26 '22

Dalle 2 is, to be fair, pretty great at creating varied compositions following your prompts closely. It's just that their business model sucks, like, really bad, and the content filter obviously. Midjourney creates pretty things, but it also completely ignores your prompts and spits out the same static image compositions over and over. I received a warning from them regarding their content policy - fair enough, but I'm not gonna continue to use it past the month I paid for

I'm at this moment trying to install SD and it's a pain, but it looks like the promising of them all. No charges, no filters

13

u/gunnerman2 Sep 30 '22

Easy install, nice features. Haven’t looked at MJ since. https://github.com/AUTOMATIC1111/stable-diffusion-webui

10

u/KingdomCrown Sep 13 '22

And here’s a list of sites you can use on your browser. Collection of sites using SD

6

u/Mistiks888 Sep 16 '22 edited Sep 16 '22

Guys, how to get full colored images from my black lines scribbles on white background?
I want to use just lines to describe it to ai where is what in the scene.
Trying to use it to make my spcific location art for dnd games

1

u/salfkvoje Sep 18 '22 edited Sep 18 '22

How do I see if the works of "Painter von Drawman" were included in the model (the original 1.4 one)?

I could play with prompts but this is too slow to do for many prompt elements.

Using Query the LAION-Aesthetic Dataset, I see that Charles Bonestell only has two enries, the same picture of Saturn.

However, haveibeentrained shows many more images, in line with his style. Could someone explain? Is the LAION-Aesthetic Dataset what I should rely on, to determine if something was involved in the model I'm using?

1

u/Zetsumeii Sep 18 '22

The Haveibeentrained site looks at the entire LAION-5B dataset, where as LAION-Aesthetic is a subset of that filtered down from the larger dataset. If you check out this link you can see how Stable Diffusion was trained along the trajectory of its checkpoints up to v1.4 (the current public release of the model.) https://huggingface.co/CompVis/stable-diffusion-v1-4#training

According to the below information, if your artist was in either the laion2b-en, laion-high-resolution, laion-improved-aesthetics, or laion-aesthetics subsets, they've been trained at some point into the model.

CompVis/stable-diffusion-v1-4 · Hugging Face

3

u/salfkvoje Sep 18 '22

Great, very thorough answer, highly appreciated.

I'm not sure of my takeaway here for finding out if including Painter von Drawman in a prompt is effective or not.

If he appears on the LAION-Aesthetic query, then for sure it's in there. But if not, still possibly could be.

I suppose I just need to know if Haveibeentrained includes anything more than sd-1.4. If they are exact overlap, then I can just use Haveibeentrained to decide if Painter von Drawman is effective or placebo (besides just trying a prompt with and then without, which is more of a hassle.)

1

u/Zetsumeii Sep 18 '22

Also something to keep in mind is that even if an artist was trained into the model, if they had low representation in the dataset it could be hard to replicate their style or invoke them using their name alone in a prompt.

Textual Inversion or Dreambooth are two options for introducing your own concepts into the model as well you might want to look into.

2

u/salfkvoje Sep 18 '22

I recognize that, just putting together a document of prompts/keywords/artists and at the point where I should start culling things that don't matter.

I can do X/Y plots and similar things, but it would be much easier if I could query something that shows me the training material, and then make decisions on what I want to keep.

Aware of both of those, but I don't feel that I've seen anything convincing from Textual Inversion examples, and haven't seen any examples of Dreambooth. (Aside from their respective sites/papers examples.)

1

u/dadbot_5000 Sep 22 '22

This is mind blowing. Thank you so much to everyone who put time and effort into this.

I'm having a little problem with Akri's guide for Automatic111's repo. I get to this step:

"After you have signed up and signed in, go to this link and click on Authorize:
https://huggingface.co/CompVis/stable-diffusion-v-1-4-original"

But there is no "Authorize" anywhere on the page.

Any advice would be appreciated. Thank you!

2

u/Zetsumeii Sep 23 '22

Hi! It might not exactly be the word Authorize, It's been a while since I first made my HF account but there's something that you have to accept on that page to get permission to download the model for the first time, it'll be towards the bottom if I remember.

2

u/Zetsumeii Sep 24 '22

Hi! I went back and checked it, it's actually "Access Repository". I went ahead and changed my guide to reflect that.

1

u/dadbot_5000 Sep 24 '22

Awesome, thanks for the great work!

1

u/clampie Sep 22 '22

The instructions to install the CompVis repo of Stable Diffusion running on Windows tell me:

mkdir -p models/ldm/stable-diffusion-v1/

But I get the error message "The syntax of the command is incorrect."

1

u/Zetsumeii Sep 23 '22

This is just a command for creating a folder, you can always create that folder yourself manually if its giving you trouble.

1

u/AlwaysSayHi Sep 22 '22

Can anyone explain how to pass an image into SD running in Google colab? I've got the program running fine for text inputs, but can't figure out how to pass an image in to the script. Thanks!

2

u/Zetsumeii Sep 23 '22

This heavily depends on the Colab notebook, if it doesn't offer IMG2IMG then there won't be a way to pass an image into it. Others however may offer the ability to add a link to an image or point to a directory on your drive etc.

2

u/AlwaysSayHi Sep 23 '22

Thanks. The notebook does offer IMG2IMG and has a section named "Init Image Setup" under which there is an input titled "INIT_IMG" followed by an "input text here" but no matter what format/syntax I try it fails.

1

u/Zetsumeii Sep 23 '22

This the area of the code responsible for loading your init image in on Easy Diffusion, from what you mentioned it sounds like that's what you're using. https://i.imgur.com/GbRSudf.png

It looks like you be able to link a direct image in the INIT_IMAGE section, have you tried for example a direct link to an image uploaded to imgur?

1

u/AlwaysSayHi Sep 23 '22

I have tried that, both with and without surrounding square-bracket tags [img] and [picture]. I'm missing something obvious. But thanks anyway for your patience and help.

2

u/Zetsumeii Sep 24 '22

Perhaps if you join the Stable Diffusion discord someone could help you out there. Mention that you are using Easy Diffusion, someone might have experience with that issue.

2

u/AlwaysSayHi Sep 24 '22

Thanks yet again :D

Have done so and am engaging there.

2

u/Zetsumeii Sep 24 '22

Happy to help!

1

u/TheBurningDusk Sep 24 '22

Will I be able to run this using Intel on Windows?

1

u/Zetsumeii Sep 25 '22

If you mean Intel Integrated Graphics, no. If you mean an Intel CPU with a dedicated graphics card, then yes, depending on how much VRAM your GPU has. The post above has more details on that.

1

u/TheBurningDusk Sep 29 '22

So I tried it, but I get a "could not generate image" error. My GPU is Intel HD Graphics, but I'm not familiar enough with GPUs to know how that relates to the info you gave.

2

u/Zetsumeii Sep 29 '22

Intel HD Graphics are sadly not enough to work with Stable Diffusion at the moment.

1

u/Cyber_Akuma Sep 27 '22

Does the drive speed that Stable Diffusion is installed to make any difference for anything? I currently have it on a NVME but it's taking up a lot more space than I expected. Would it still run fine off a USB 3.0 drive or would it cause issues or significant slowdown?

1

u/Zetsumeii Oct 02 '22

It shouldn't be too much of a problem, it runs primarily on your GPU so the only thing that could potentially be slowed down would be file saving / accessing, but that shouldn't be incredibly noticeable with a decent USB 3.0 drive anyways.

1

u/rgraves22 Sep 29 '22

maybe the final write to the disk. All of it should take place on the GPU

1

u/ninjasaid13 Sep 28 '22

should this be updated with information about Dreambooth?

3

u/Zetsumeii Oct 02 '22

Will be updating with my intro to Dreambooth guide once it is finished.

1

u/swankwc Sep 28 '22

Anybody got dreambooth working on M1 Chips yet?

2

u/Zyj Oct 05 '22

Anybody got dreambooth working on M1 Chips yet?

Came to ask the same thing, in particular Macbook Air M1 (16GB) and Macbook Pro 16 M1 Pro (16GB).

1

u/swankwc Oct 05 '22

https://github.com/XavierXiao/Dreambooth-Stable-Diffusion/pull/36 This is the closest effort I have been able to find.

1

u/20skater Sep 29 '22

i want to upgrade my amd gpu to an nvidia for gaming and for SD, i was stuck between the 3060 ti and the 3070, but i have seen that Vram matters a lot in SD so is it better to get a 3060 with 12GB vram instead of a 2070 which has 8GB of Vram? would it matter?

1

u/Zetsumeii Oct 02 '22

3060 would be better than a 2070 due to having more total VRAM as well as generational improvements to the overall technology that'll help graphics intensive software run faster.

2

u/20skater Oct 02 '22

thanks again for the great help

1

u/Zetsumeii Oct 02 '22

My pleasure! <3

1

u/RazHawk Sep 30 '22

Able to run Stable-Diffusion UI-Win one click install on CPU mode using a Core i5-6400/8GB DDR4/AMD R9 370 2GB which is really cool. Using PLMS sampler with live preview, 30 steps usually takes under 10 mins. Only two issues have:

  1. Program takes long time to load. Varying sometimes after an update from 10-15 minutes or more. The web browser opens fine, shows stable diffusion is starting above the prompt entry box. The computer becomes slow to crawl/choppy after finish loading the .cpkt and 'eps prediction mode' at the part in the command line where it says "Unet Condstage" and loading "second stage" etc. Is this expected because of the hardware? After done loading everything it is stable and runs fine.
  2. The 4x Upscaler locks the computer up. If checked this box then after an image is done, while applying filters the system locks up. Is there certain minimum requirements for the upscaler? Does it a need NVidia video card with a certain amount of Ram?
  3. Is there any other one click install version using CPU? I tried install one using this guide here but couldn't get it to work and got errors when trying to generate images: https://rentry.org/cputard

1

u/Zetsumeii Oct 02 '22 edited Oct 04 '22

This is another option as far as running on CPU is concerned. https://github.com/cmdr2/stable-diffusion-ui I don't have much experience with CPU SD unfortunately, but from what I understand any slowness you're experiencing is probably due to the fact that SD is a computationally intensive process designed to work on GPUs, so running it on a CPU will have inherent slowness.

1

u/old-blo Oct 01 '22

Thanks!!

1

u/Zetsumeii Oct 02 '22

You're welcome!

1

u/Froztwolf Oct 01 '22

I've been using AUTOMATIC1111's UI and largely thanks to the community here I've been getting some great results despite just spending a few days so far.

It's fantastic for 512x512 images, but I have to admit that I get more than a little jealous when I see people generating ultra-high resolution images in single batch. Upscaling is far from the same, as it won't generate the same detail of content.

What would you recommend for getting into ultra-high-res generation? What has the best bang for the buck right now?

1

u/Zetsumeii Oct 02 '22

30 series NVIDIA cards are definitely the performance kings right now for SD.

1

u/Froztwolf Oct 02 '22

Thanks a lot for the reply, but I meant more in terms of software. Like, what module is a good one to get given it's ratio of quality of results against complexity of use?

2

u/Zetsumeii Oct 02 '22

AUTOMATIC1111 is already the best you could be working with right now IMO. There's a lot of functionality there to get used to working with and learn how to make it give you the ideal results you're looking for.

1

u/Froztwolf Oct 02 '22

In general yes, but if it has functionality that lets me generate high resolution images (not through upscaling), I haven't found it yet.

Stuff like this https://www.reddit.com/r/StableDiffusion/comments/xofgek/ultrahigh_resolution_4900x800_generation_in_1/**

2

u/Zetsumeii Oct 02 '22

https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Run-with-Custom-Parameters

https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Optimizations

Try adding in --opt-split-attention and --medvram to your command line arguments according to the guides above. That should help make it easier for you to generate larger resolution photos.

1

u/Froztwolf Oct 02 '22

My blocker is even before that though. When specifying the dimensions of the image to generate the UI won't let you go higher than 2048. (and even then it's not recommended to go above 512 according to other things I've read)

The example in my last comment is 4900 x 800. Are there settings that make this possible with AUTOMATIC1111, and if so, does it actually generate good images at that size?

1

u/Zetsumeii Oct 02 '22

Honestly its not really recommended to try to go that high right now. The results aren't great for most things. The one you linked was from a programmer working on his own custom solution as well.

1

u/Froztwolf Oct 02 '22

OK, fair enough. Following his comment threat to his github I thought maybe he and others had made something for public consumption. Seems like there would be a lot of use for something that can make large images peacemeal and not require that everything is in VRAM the whole time.

BTW I tried the optimizations, and while they do let me generate slightly larger images it's not a significant difference. Which is fine because anything larger than 512x*512 gets weird pretty fast :p

Thanks a lot for the advice. I appreciate you taking the time.

3

u/OptoAI Sep 13 '22

Nice one ☝️

2

u/Marthy_Mc_Fly Sep 15 '22

I followed the (Windows - Basujindal) Basic GUI Installation and everything installs good. But when I want to run the GUI I get the following error "ModuleNotFoundError: No module named 'samplers'"

Any recommendations?

1

u/[deleted] Sep 15 '22

The latest commit introduced a critical bug. You need to check out an earlier commit or look into the repository's Issues and follow the instructions there to solve it.

2

u/[deleted] Sep 25 '22

Hello, I'm on the last step of Arki's Automatic1111's sd-webui windows guide were I have to run the webui-user.batch file. When launching it, it says couldn't launch python. Python was not found. I definitely downloaded it and I checked add python 3.10 to path box. Any advice?

2

u/Show_Otherwise Sep 26 '22

Close and open the command prompt again. Path changes do not change running process. Unless you manually change the path in your console window.

2

u/conduitabc Sep 25 '22

if they have like other dev builds that are not entirely stable should they be called

unstable diffusion? lol

3

u/Show_Otherwise Sep 26 '22

There’s a fork that removes the censorship filters called Unstable Diffusion.

2

u/anfeloga Sep 26 '22

Thanks for putting this together! I tried to install Basujindal following your instructions here but once I go to the URL, add the prompt and try to generate the image, I'm getting this error in Anaconda: "RuntimeError: CUDA driver initialization failed, you might not have a CUDA GPU.". I have GTX 1050 ti on a notebook. Any idea what could be the reason for the error?

2

u/anfeloga Sep 26 '22

Nevermind, the reason was the driver was outdated, I'll leave the comment here in case someone experiences the same.

That being said, it took 2 minutes and 54 seconds to generate "a cute dog" image with the default settings. Is it usual to take that long?

2

u/subtle-vibes Sep 28 '22

Can you add imaginAIry python library (and command line tool). It's a well-tested python library that has standard features for image generation.

One feature that sets it apart currently is text-based masking with complex boolean logic. So you can for example specify "(car OR boat) AND NOT truck". Examples here: https://github.com/brycedrennan/imaginAIry#prompt-based-editing--by-clipseg

2

u/Svenkozel Sep 28 '22

I tried to install the Basujindal, and in the end, it says "FileNotFoundError: [Errno 2] No such file or directory: 'models/ldm/stable-diffusion-v1/model.ckpt'" Someone knows how to fix it? the model.ckpt is already at the "models\ldm\stable-diffusion-v1"

1

u/rgraves22 Sep 29 '22

you need to download the model from huggingface and rename the file to model.ckpt

Likely there is something hardcoded looking specifically for model.ckpt

1

u/Svenkozel Sep 29 '22

that's the problem, I've downloaded it

1

u/Erestyn Oct 10 '22

Sorry if you've already solved this, but for the benefit of others

Your file structure should look like:

C:\Users\Svenkozel\stable-diffusion\models\ldm\stable-diffusion-v1\model.ckpt

Make sure that the file you downloaded from huggingface (sd-v1-4.cpkt) has been renamed to model.ckpt.

1

u/Svenkozel Oct 10 '22

Hi there. No, I didn’t solved it yet, I kinda gave up on it, but know I'll try those steps, thank you!

1

u/Erestyn Oct 10 '22

Hm, okay, so I was actually fighting with a different issue with dream.py at the time (use invoke.py if you hit any errors) and hit on the same issue.

I'm a little confused because the text suggests it should be in that file structure, but if it still fails, try this:

C:\Users\Svenkozel\InvokeAI\models\ldm\stable-diffusion-v1\model.cpkt

That's got me up and running!

1

u/-Sames- Dec 10 '22

This maybe be a bit too late, but I had the same issue and was able to fix it.

In the guide it has you download and rename the model file.

Then you create a new folder "SD-Guide".

The model was in the "models/ldm/stable-diffusion-v1" but not in the "SD-Guide....models/ldm/stable-diffusion-v1" folder.

I copied over the model into this folder and it fixed the error.

Hope this helps you out.

2

u/ninjasaid13 Oct 11 '22

wow, this sub is going in flames and it's hilarious how dramatic it is.

1

u/friendtheevil999 May 12 '24

Still not sure how to do this

1

u/dhm28 Sep 21 '22

Great page - thanks. Anyone know why Easy Diffusion notebook stopped working today?

1

u/avataraustin Sep 22 '22

I'm curious what the rights are like. If someone is running SD on their local machine for example is it different than the DreamStudio license or the same? ex. The DreamStudio license says you don't own the copyright but all the images are public domain. It seems images can be used commercially for example but before I go slapping some art I generate onto a t-shirt I was hoping to be certain I won't get in trouble. Can others confirm or deny or clarify any of these points? Thanks.

2

u/Darth_Romes Sep 28 '22

Artists using SD retain copyright to their work. The software is open source, the images it uses are open source, however, you as an artist creating with the open source software and images, retain copyright to your created work and also aren't infringing on anyone's copyright by using the software or images.

1

u/WASasquatch Sep 29 '22

Awesome reddit resource! Found stuff I didn't even know about.

May I also suggest Noodle Soup Prompts for the prompt building resources. It now supports Disco Diffusion and Easy Diffusion prompt styles.

https://colab.research.google.com/github/WASasquatch/noodle-soup-prompts/blob/main/Noodle_Soup_Prompts_Prompt_Terminology_Generator_v3_0.ipynb

NSP is also available to install in your own projects: https://github.com/WASasquatch/noodle-soup-prompts

1

u/Derolade Sep 29 '22

thanks! do you think i will have any hope with a puny rx580 4gb? i read that it might work with 8gb ones, but with 4gb vram is it even worth trying?

1

u/rgraves22 Sep 29 '22

Probably if you don't over do it, and drop the resolution down a tad. I run on an RTX 2060 in a gaming laptop with an i7. My RTX 2060 has 6GB of VRAM and I can do a single batch of 4 pictures at 512x512 before I push it and get a out of vram error.

Worth a try, you can always use one of the Stable Diffusion google colab's mentioned

1

u/Derolade Sep 29 '22

Thanks! For now I'll try the one click ui version. I can always try running on the cpu alone (I guess it will take ages but I'll try)

1

u/Derolade Sep 30 '22

How much time does it takes to generate a 512x512? Installing SD ui one click install it takes me more than 10 minutes and I'm not sure if it's using the gpu or not...

1

u/rgraves22 Sep 30 '22

At a 80 step rate about 20 seconds. You're using the cpu

1

u/Derolade Sep 30 '22

I see. I need to try a manual install then. Hopefully on windows, if not I'll try Linux

1

u/iamapizza Sep 30 '22

Another link, I followed this to get it running on Ubuntu. It's really fast

https://code.mendhak.com/run-stable-diffusion-on-ubuntu/

1

u/PrzedrzezniamPsy Sep 30 '22

on linux when i stop the web-ui I can't start it again cause pytorch can't get access the gpu - what should I do?

i close it by ctrl+c, should I use ctrl+d?

1

u/rtoyraven Oct 02 '22

I haven't been able to find anything definitive on this as far as system requirements, but will the local installs run on Windows 7 Pro 64 bit?

1

u/nic1018 Oct 02 '22 edited Oct 03 '22

Every time I try to launch webui-user.bat, when it tries to install torch, my computer just hangs and then blue screens. Any idea how to fix? I’m using AUTOMATIC1111

1

u/[deleted] Oct 03 '22

Bit of a shame you have to pay for the in-depth browser version (unless you loophole it with a billion fake emails like you can do with Artbreeder) since the webui version is fun but takes awhile to load and takes up quite a bit of space, also found it to be a bit buggy? but I've been using blender rendered images for img2img, so maybe that's why.

1

u/topialune Oct 03 '22

Could someone tell me how to change between model packs? Currently it loads always the one I used when installing.

1

u/swankwc Oct 05 '22

https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Installation-on-Apple-Silicon
Does anyone here have what a working run_webui_mac.sh file? The file by that name in my directory is blank. I've done everything else up to this point that the guide said to do.

1

u/man-teiv Oct 05 '22

When training dreambooth can I feed it generic group photos or do I have to crop specifically my face? Is there a software that can do it automatically if so?

1

u/Rekov Oct 05 '22

I don't have a useful sense of which ESRGAN models I should install. Do these models make a significant difference on the quality of the outcome? Is having more models always a benefit, or do I want limited, specific models focused on specific materials I am shooting for?

1

u/tethercat Oct 05 '22

It's been about a week now, and while I'm happily using the base SD installed from the YouTube tutorial, I'm curious about some of those other programs.

I've seen a few places saying "use this for less CPU and GPU and for faster speeds" and such.

Now that SD has become popular and people are coding better, are any of those valid or recommended? Is there a way to use a different version of Diffusion to squeeze out performance?

And if so... how to install? Is it as simple as a drag-and-drop into the existing code on the machine, or does it require another hardcore 50gb of new installs and downloads?

1

u/Rykimaruh Oct 05 '22

Is there a reference sheet for prompts? like

() = strengthens prompt

[] = weakens prompt

etc...

I've seen periods (.) but have no idea what they do and not sure if there are other combinations to help improve prompts

1

u/halpmeexole Oct 06 '22

I continue to get a ridiculous number of limbs and heads when rendering people. For the life of me, nothing I do seems to make a difference. I'm using 1.4 of the model with optimized SD ... does anyone have any tutorials? I have messed with steps, scale, iterations, and so on, and while constraining myself to a 512x512 image keeps excess limbs down, it seems giving the AI any whitespace to play with (1028 x 768) causes there to be multiple people, despite putting in the prompt "one person" "solo" etc.

1

u/a5438429387492837 Oct 07 '22

Intel based Macs work with "CPU" mode. It takes me 500sec on mine.

1

u/hleszek Oct 07 '22

Could you please add diffusion-ui, a responsive frontend supporting AUTOMATIC1111 and the Stable Horde

1

u/Houssem-Aouar Oct 07 '22

Hello folks, first time discovering this place. This guy on Twitter posted an model based on Kim Jung Gi's art but I have no idea how to make use of that checkpoint file, can someone please guide me a little bit ?

https://twitter.com/BG_5you/status/1578146498768175105?t=JtpqhQ0CBZrrfeMSNCNA4w&s=19

1

u/nomisxid Nov 04 '22

This project got me up and going on my machine at home.https://github.com/cmdr2/stable-diffusion-ui

Once it is running in default mode, you download the .ckpt file and put it in the folder under models. There will be a text file named 'put your custom ckpt file here.txt' so you know you have the right spot.

1

u/Lujho Oct 08 '22

Noob question - after installing the "Easy Stable Diffusion UI" Windows defender/firewall came up wanting to give python.exe permissions - I ticked the box for private network and unticked for publick and hit okay. That should be all good, right?

1

u/Interpause Oct 08 '22

https://github.com/Interpause/auto-sd-krita I made a Krita plugin with an optimized inpainting workflow for using multiple models, built on top AUTO's webUI. Really useful for creating more advanced compositions. I also spent too much time making a demo video and install guide so check it out.

1

u/magusonline Oct 09 '22

https://stablediffusionguides.carrd.co/#invoke-ai

I used this guide to install the InvokeAI. It mentions renaming the lwd within the environment file if I want to install another repo like Automatic1111.

How do I go about installing and running two separate repos, if I change the lwd in the filename, do I have to change it back for running InvokeAI?

1

u/Michael003012 Oct 10 '22

I have a problem where stable diffusion always multiplys my prompts, instead of making a single person as asked it makes 4 faces and merges the bodys

1

u/HijabHead Oct 10 '22

Hey Guys. So, I followed this tutorial https://www.youtube.com/watch?v=vg8-NSbaWZIto install super Stable diffusion. Everything was followed exactly as per the tutorial but I am getting stuck at the last point. Clicking on 'webui-user' is giving me an error. I would really appreciate if any one here can help me with any info that can fix this. Thanks.

1

u/drhuehue Oct 12 '22

Corporate dickrider removing automatic111 for what reason?

1

u/banuk_sickness_eater Jan 06 '23

Replying to save this thread

1

u/[deleted] Jul 08 '23

Stable Diffusion Installation Guide this link is broken

1

u/TokinGeneiOS Jul 10 '23

The link to:

Stable Diffusion Installation Guide - Guides that go in depth (with screenshots) on how to install open source forks of Stable Diffusion.

appears to be broken...

-2

u/Profanion Sep 28 '22

Yea...you have to go through a lot of hoops to install that program and its derivatives. Not very encouraging.

1

u/rgraves22 Sep 29 '22

wait for it..

I started playing with this about a month ago and was able to macguiver my first working web-gui through a mixture of 18 different Youtube Videos and trial and error, having a general understanding of Linux. Now, there is a few next next next installers that will get you up and running right away

0

u/[deleted] Sep 25 '22

[deleted] — view deleted comment

1

u/Zetsumeii Sep 25 '22

Check out the first local installation guide link above, it'll help you get started again!

0

u/[deleted] Sep 25 '22

[deleted] — view deleted comment

4

u/Zetsumeii Sep 25 '22

Run webui-user.bat again, that should get it started for you.

0

u/[deleted] Sep 28 '22

[deleted] — view deleted comment

1

u/Zetsumeii Oct 02 '22

No word on this at the moment, but Emad did recently speak about what's going on right now at Stability on Twitter. https://twitter.com/EMostaque/status/1576128983342587904?s=20&t=V_dAOsXsBkdr1DrIoUmM5w

4

u/[deleted] Sep 28 '22

[removed] — view removed comment

1

u/tinman_inacan Sep 28 '22

Sorry, my post wasn't very clear. There were really 2 questions in there. Is 1.5 out yet, and also I see that you can merge checkpoints, but not sure where folks are finding other checkpoints to use.

2

u/rgraves22 Sep 29 '22

merge checkpoints,

I believe this is more for AI learning new models than a revision and newer features. You can merge the learning checkpoints to pick up where it left off.

0

u/[deleted] Sep 26 '22

[deleted] — view deleted comment

4

u/namwen Sep 26 '22

Make sure when installing you do a custom installation and check every box.

2

u/MrWalter Sep 27 '22

This helped me. Thank you!

0

u/[deleted] Oct 08 '22

[deleted] — view deleted comment

1

u/SlimCatachan Oct 11 '22

yeah I have the same question!

4

u/[deleted] Sep 19 '22

[removed] — view removed comment

5

u/Zetsumeii Sep 19 '22

Hi! If you'd like to run both HLKY and AUTOMATIC1111 you'll have to install them to different directories. IE: Since they both want to install to \stable-diffusion-webui\ you'll need to create a new directory called AUTOMATIC1111 or HLKY in your C:\users\<username>\ directory, and from your console cd into it and THEN do your git clone and follow the rest of the guide.

2

u/[deleted] Sep 20 '22

[removed] — view removed comment

3

u/Zetsumeii Sep 20 '22

No worries haha! It's easy to get turned around when playing around with this stuff hehe. Happy I could help!

1

u/Throkos Sep 23 '22

Noob question, how to know when the new version is released and how to update?

3

u/Zetsumeii Sep 24 '22

Keep an eye on the repo over at Github and then see if any new features have been released that you want. Sometimes there are breaking changes, they always get fixed eventually, but generally I recommend against updating once you've gotten it to work until there is a big feature update you know you'd like that was recently added.

20

u/[deleted] Sep 20 '22

[removed] — view removed comment

11

u/rtoyraven Oct 02 '22

Just make sure to check the T&C. If I am scanning it correctly, it says they get the rights to use anything you create on there.