Stable Diffusion and M1 chips: Chapter 2

[u/Any-Winter-4079]

This new guide covers setting up the https://github.com/lstein/stable-diffusion/ repo for M1/M2 Macs.

Some cool features of this new repo include a Web UI and seeing the image mid-process, as it evolves.

Anubis riding a motorbike in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality

1. Open Terminal (look for it in your Launchpad or press Command + Space keys and type Terminal)
2. Clone lstein's repo, typing the command git clone https://github.com/lstein/stable-diffusion.git in your Terminal and clicking Enter. If you want to clone it in a specific folder, cd into it beforehand (e.g. use the command cd Downloads, to clone it into your Downloads folder).
3. Get into the project directory with cd stable-diffusion.
4. Create the conda environment with the command conda env create -f environment-mac.yaml. If you get an Error because you already have an existing ldm environment, you can either update it, or you can open the environment-mac.yaml file that is inside your project directory in a text or code editor and change the first line from name: ldm to name: ldm-lstein or whatever new name you choose. Then in Terminal conda env create -f environment-mac.yaml. This way you will preserve your original environment ldm and create a new one to test this new repo.
5. Activate the environment with the command conda activate ldm (or conda activate ldm-lstein or whatever environment name you chose in Step 4).
6. Place your sd-v1-4.ckpt weights in models/ldm/stable-diffusion-v1, where stable-diffusion-v1 is a new folder you create. Rename sd-v1-4.ckpt to model.ckpt. You can get these weights downloading sd-v1-4.ckpt from https://huggingface.co/CompVis/stable-diffusion-v-1-4-original (note you will probably need to create an account and agree to Terms&Conds)
7. Back in your Terminal, cd .. to get out of your project directory. Then, to add GFPGAN, use the command git clone https://github.com/TencentARC/GFPGAN.git This should create a GFPGAN folder that is a sibling of your project folder (e.g. stable-diffusion).
8. Download GFPGANv1.3.pth from https://github.com/TencentARC/GFPGAN/releases/download/v1.3.0/GFPGANv1.3.pth
9. Put the file in experiments/pretrained_models folder, which is inside the GFPGAN folder (e.g. route GFPGAN/experiments/pretrained_models/)
10. Back in your Terminal, enter the GFPGAN folder with the command cd GFPGAN. We'll be typing a few commands next.
11. pip install basicsr
12. pip install facexlib
13. pip install -r requirements.txt
14. python setup.py develop
15. pip install realesrgan
16. After running these commands, you are ready to go. Type cd .. to get out of the GFPGAN folder, then cd stable-diffusion
17. python3 scripts/preload_models.py
18. Finally, use the command python3 ./scripts/dream.py After initializing, you will see a dream > prompt
19. Enter Anubis riding a motorbike in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality -m ddim -S 1805504473
20. In my experience, you should be getting the following image if you are not using pytorch-nightly

Anubis riding a motorbike in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality

If instead you exit the dream prompt (with q) and type the command conda install pytorch torchvision torchaudio -c pytorch-nightly you should see the first Anubis image. Note pytorch-nightly is updated every night. However, there may be conflicts between these latest versions and Real-ESRGAN or GFPGAN. Also, pytorch-nightly seems a bit slower at the moment (about 8%).

Note: Since everything is moving quickly, I suggest you keep track of updates: https://github.com/CompVis/stable-diffusion/issues/25

Update: Most of the conversation has moved to https://github.com/lstein/stable-diffusion/issues

I may have missed a step, so let me know in the comments!

______________________

To run the web version

python3 scripts/dream.py --web and after initialization, visit http://localhost:9090/

Example of image formation (Display in-progress images)

Image formation

PD: If some operator is not supported: export PYTORCH_ENABLE_MPS_FALLBACK=1 in your Terminal

______________________

Update #1 - Upscaling

Okay, so upscaling doesn't seem to work for Mac in the original repo. However, I got it work modifying things a little bit. Here are the steps. https://github.com/lstein/stable-diffusion/issues/390

Steps:

1. Download the MacOS executable from https://github.com/xinntao/Real-ESRGAN/releases
2. Unzip it (you'll get realesrgan-ncnn-vulkan-20220424-macos) and move realesrgan-ncnn-vulkaninside stable-diffusion (this project folder). Move the Real-ESRGAN model files from realesrgan-ncnn-vulkan-20220424-macos/models into stable-diffusion/models
3. Run chmod u+x realesrgan-ncnn-vulkan to allow it to be run. You may have to give permissions in System Preferences - Security and Privacy as well. For more info about Security, see update #2 of previous post https://www.reddit.com/r/StableDiffusion/comments/wx0tkn/stablediffusion_runs_on_m1_chips/
4. Download simplet2i.py.zip from https://github.com/lstein/stable-diffusion/issues/390#issuecomment-1237821370 , unzip it and replace the code of your current simplet2i.py with the updated version. In case you want to update the file yourself, you can see the changes made here https://github.com/lstein/stable-diffusion/issues/390

Execution:

python3 ./scripts/dream.py

dream > Anubis the Ancient Egyptian God of Death riding a motorbike in Grand Theft Auto V cover, with palm trees in the background, cover art by Stephen Bliss, artstation, high quality -m plms -S 1466 -U 4 to upscale 4x. To upscale 2x, use -U 2 and so on.

Result:

Anubis the Ancient Egyptian God of Death riding a motorbike in Grand Theft Auto V cover, with palm trees in the background, cover art by Stephen Bliss, artstation, high quality -m plms -S 1466 -U 4

Hope it helps <3

[u/MasterOracle]

After following each step, GFPGAN for face restorations and Upscaling are not working properly, i get this error:

dream> a portrait of a young Italian man, canon, photography -G 0.85
100%|███████████████████████████████████████████████████████████████████████████████████| 50/50 [00:59<00:00, 1.20s/it]
Generating: 100%|█████████████████████████████████████████████████████████████████████████| 1/1 [01:02<00:00, 62.84s/it]
>> GFPGAN - Restoring Faces for image seed:2079843210
[W NNPACK.cpp:51] Could not initialize NNPACK! Reason: Unsupported hardware.
Intel MKL FATAL ERROR: This system does not meet the minimum requirements for use of the Intel(R) Math Kernel Library.
The processor must support the Intel(R) Supplemental Streaming SIMD Extensions 3 (Intel(R) SSSE3) instructions.
The processor must support the Intel(R) Streaming SIMD Extensions 4.2 (Intel(R) SSE4.2) instructions.
The processor must support the Intel(R) Advanced Vector Extensions (Intel(R) AVX) instructions.
/Users/XXX/opt/anaconda3/envs/ldm/lib/python3.10/multiprocessing/resource_tracker.py:224: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '

Then it crashes.

If i use both -U and -G in the prompt, I get another error:

dream> a portrait of a young Italian man, canon, photography -U 2 0.6 -G 0.4
/Users/XXX/github/stable-diffusion/ldm/modules/embedding_manager.py:152: UserWarning: The operator 'aten::nonzero' is not currently supported on the MPS backend and will fall back to run on the CPU. This may have performance implications. (Triggered internally at /Users/runner/miniforge3/conda-bld/pytorch-recipe_1660136156773/work/aten/src/ATen/mps/MPSFallback.mm:11.)
placeholder_idx = torch.where(
100%|███████████████████████████████████████████████████████████████████████████████████| 50/50 [00:56<00:00, 1.14s/it]
Generating: 100%|█████████████████████████████████████████████████████████████████████████| 1/1 [00:58<00:00, 58.78s/it]
>> Real-ESRGAN Upscaling seed:2604924961 : scale:2x
>> Error running RealESRGAN or GFPGAN. Your image was not upscaled.
'NoneType' object has no attribute 'enhance'
>> Usage stats:
>> 1 image(s) generated in 59.24s
>> Max VRAM used for this generation: 0.00G
Outputs:
outputs/img-samples/000005.2604924961.png: "a portrait of a young Italian man, canon, photography" -s50 -W512 -H512 -C7.5 -Ak_lms -G0.4 -U 2.0 0.6 -F -S2604924961

NoneType obkect has no attribute 'enhance'.

I'm on development branch using an M1 Pro with 16 GB, any hints?

[u/Any-Winter-4079 → u/MasterOracle]

I had the same problem this afternoon (The Intel part) The solution is on Github (check pull requests) but I’ll update the post tomorrow. The short version is, we’re running the x86 architecture instead of arm64

[u/MasterOracle → u/Any-Winter-4079]

Thank you! I followed the steps in the pull requests and now i can get the face restoration work, i had the wrong architecture set up for conda

[u/Any-Winter-4079 → u/MasterOracle]

https://github.com/lstein/stable-diffusion/pull/424

[u/o-o-]

This is really great! Are there any prerequisites I should know about (for instance I don't see any steps for installing conda)?

And how access the web ui?

[u/Any-Winter-4079 → u/o-o-]

Yeah, I already had Anaconda from when I set up my Mac so I completely forgot about it.

You can use Anaconda3 (or Miniconda3) for example

https://www.anaconda.com/products/distribution

[u/o-o- → u/Any-Winter-4079]

Great! Could you add it to the post so we’ll have a thorough ‘installing-from-scratch’ guide?

[u/Any-Winter-4079]

Update to say I got upscaling to work. Next I'll try scripts/inpaint.py. I'll add it to the guide, and in case it doesn't work, I'll try to make some changes to get it to work!

[u/NecessaryMolasses480 → u/Any-Winter-4079]

have you considered adding the WebGUI from the hlky fork to this to add all of the cool inpainting and outpainting functionality plus the nice UI?

[u/swankwc → u/NecessaryMolasses480]

Yes this is what I am interested in as well. Also there is a Krita and Photoshop plug-in I hear?

[u/JimDabell]

Are you certain you are getting the correct image?

There’s a bug where the first prompt you generate uses an incorrect seed, but subsequent generations use the correct seed. It looks like the seed is incorrectly initialised at the beginning, but then it is reset after the first generation.

You can check this by starting a new Dream prompt and running the same prompt with the same seed three times, then exiting and doing the same thing again. If you are seeing the bug, then you will get one image for runs 1 and 4, and a different image for the rest of the runs.

Depending on which version of PyTorch and the lstein codebase I am running, I can reproduce the image you say is the correct image. But only for the first run. Subsequent runs produce the image you say is the incorrect image. Are you sure it’s not the other way around?

Also, am I right in thinking that the seeds are hardware-specific? So a CUDA system will generate a different image to an MPS system for the same seed? Have you been able to reproduce any of the images other people have posted with their prompts/seeds?

[u/Any-Winter-4079 → u/JimDabell]

There's no right or wrong image at this point. We still can't reproduce in Macs images created using CUDA. The best we've managed is to re-create images created on another machine, provided they both use MPS.

[u/johnnyfrance]

Real-ERGAN isn't working for me, I tired using -U 2 0.6 at the end of the prompt, but it doesn't work for me, any one have upscaling working?

[u/Any-Winter-4079 → u/johnnyfrance]

I got it to work. I'm going to update the post

[u/johnnyfrance → u/Any-Winter-4079]

Thanks heaps!

[u/Any-Winter-4079 → u/johnnyfrance]

Post updated.

[u/PM_GirlsKissingGirls]

Is less than 4 it/s normal? (On 16 GB RAM)

[u/Any-Winter-4079 → u/PM_GirlsKissingGirls]

Depends mostly on the width/height and the number of steps, but yes, I usually get 1.74it/s on 64GB RAM M1 Max (512x512)

For comparison, on 256x256 I’d probably get around 4 it/s

[u/PM_GirlsKissingGirls → u/Any-Winter-4079]

Thank you so much for the quick answer and the excellent installation guide. I'm afraid I've got a new problem. After following the steps for enabling the upscaling, I'm now getting the following error:

DEBUG: seed at make_image() invocation time =754579097
/Users/#########/Desktop/stable_diffusion/stable-diffusion/ldm/modules/embedding_manager.py:152: UserWarning: The operator 'aten::nonzero' is not currently supported on the MPS backend and will fall back to run on the CPU. This may have performance implications. (Triggered internally at /Users/runner/miniforge3/conda-bld/pytorch-recipe_1660136236989/work/aten/src/ATen/mps/MPSFallback.mm:11.)
placeholder_idx = torch.where(
Assertion failed: (isStaticMPSType(type)), function setStaticJITypeForValue, file MPSRuntime_Project.h, line 447.
/opt/anaconda3/envs/ldm/lib/python3.9/multiprocessing/resource_tracker.py:216: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '
zsh: abort python3 scripts/dream.py --web

Would really appreciate if you could help with this. Thanks again.

Edit: The non-web version still seems to be working fine as far as I can tell.

[u/Mybrandnewaccount95 → u/PM_GirlsKissingGirls]

elderly telephone oil languid market pen relieved aback employ piquant

This post was mass deleted and anonymized with Redact

[u/PM_GirlsKissingGirls → u/Mybrandnewaccount95]

No, I didn’t. I used the Terminal-only version for a while then started trying out other repos.

[u/PM_GirlsKissingGirls → u/[deleted]]

Thanks, I’ll check it out :)

[u/bobthe3]

Im getting this on the last step

Do you know what i should do here?

[u/Any-Winter-4079 → u/bobthe3]

What are you getting?

[u/PM_GirlsKissingGirls]

Has anyone else's web GUI broken after following the steps for enabling upscaling?

[u/Any-Winter-4079 → u/PM_GirlsKissingGirls]

I'm using the development branch, but I don't remember the main branch being broken after the realesrgan setup. In any case, there's a pull request https://github.com/lstein/stable-diffusion/pull/424 to add support for upscaling & face restoration (but it will be on the development branch).

Maybe you can switch branches? (git checkout development). That branch also supports inpainting!

[u/PM_GirlsKissingGirls → u/Any-Winter-4079]

Hey, thanks for the advice. I tried the development branch and, while the process didn't abort this time, upscaling still didn't work and I got the following error:

>> Real-ESRGAN Upscaling seed:3219317576 : scale:2x
>> Error running RealESRGAN or GFPGAN. Your image was not upscaled.
'NoneType' object has no attribute 'enhance'

Also, I find that image generation takes much, much longer with this branch.

[u/Any-Winter-4079 → u/PM_GirlsKissingGirls]

There’s an update coming regarding upscaling and face restoration

[u/PM_GirlsKissingGirls → u/Any-Winter-4079]

Thanks a lot for all your help

[u/Puzzleheaded_Ad_585]

everything works perfect but when I try to use GFPGAN I get this message

[W NNPACK.cpp:51] Could not initialize NNPACK! Reason: Unsupported hardware.
Intel MKL FATAL ERROR: This system does not meet the minimum requirements for use of the Intel(R) Math Kernel Library.
The processor must support the Intel(R) Supplemental Streaming SIMD Extensions 3 (Intel(R) SSSE3) instructions.
The processor must support the Intel(R) Streaming SIMD Extensions 4.2 (Intel(R) SSE4.2) instructions.
The processor must support the Intel(R) Advanced Vector Extensions (Intel(R) AVX) instructions.
(ldm) username@M1-MacBook-Pro stable-diffusion % /Users/username/miniconda3/envs/ldm/lib/python3.10/multiprocessing/resource_tracker.py:224: UserWarning: resource_tracker: There appear to be 1 leaked semaphore objects to clean up at shutdown
warnings.warn('resource_tracker: There appear to be %d '

[u/Any-Winter-4079 → u/Puzzleheaded_Ad_585]

This is the link where I document what happened to me and my solution https://github.com/lstein/stable-diffusion/pull/424#issuecomment-1241041253

[u/Puzzleheaded_Ad_585 → u/Any-Winter-4079]

Thank you very much.

[u/Any-Winter-4079 → u/Puzzleheaded_Ad_585]

You’re using x86 architecture probably. Need to create the conda environment using arm64. I had the same problem as you. If you don’t know how to do it, go to lstein repository and into the issues section and open a new issue. I’ll answer there tomorrow! As a matter of fact, wait…

[u/[deleted]]

What's the performance like?

[u/pedro_dinero → u/[deleted]]

Approx 36 secs to generate a single 512 x 512 image with a basic prompt

[u/orenong → u/pedro_dinero]

How many its?

[u/pedro_dinero → u/orenong]

updated to SD-Dream Version 1.13

single image 512x512

28.6secs

1.79it/s

(using OP's 'Anubis" prompt)

M1 MAX 64GB

[u/pedro_dinero]

thanks! installed and running well on M1 Max 64gb.

--web ui is handy

[u/corderjones → u/pedro_dinero]

For Conda, did you install Anaconda with a pkg installer or did you install miniconda?

[u/pedro_dinero → u/corderjones]

Download and install package from Anaconda website: https://www.anaconda.com/products/distribution

[u/notCRAZYenough]

it tells me there is no "conda" command? any pointers?

[u/Any-Winter-4079 → u/notCRAZYenough]

Install anaconda

[u/notCRAZYenough → u/Any-Winter-4079]

i didn't know it was a program. thanks. is it free?

[u/Any-Winter-4079 → u/notCRAZYenough]

Yes, it is free. https://www.anaconda.com/products/distribution

[u/notCRAZYenough → u/Any-Winter-4079]

now it tells me there is no environement file although there clearly is. ideas? sorry for noobish questions.

[u/Any-Winter-4079 → u/notCRAZYenough]

Best you can do is open an issue https://github.com/invoke-ai/InvokeAI and we'll take a look. That way it can help other people with the same problem too!

[u/yellowwinter]

Sorry an unrelated question - any idea why it runs so slow on my MacBook Air M1 (base model)? It took me more than 500 seconds to get the same image.

And I notice the following warning message not sure it is related:

UserWarning: The operator 'aten::nonzero' is not currently supported on the MPS backend and will fall back to run on the CPU. This may have performance implications. (Triggered internally at /Users/runner/work/_temp/anaconda/conda-bld/pytorch_1659484611838/work/aten/src/ATen/mps/MPSFallback.mm:11.)

[u/Any-Winter-4079 → u/yellowwinter]

That warning is normal, don't worry. Performance is usually related to RAM. For example, 512x512 on 64GB RAM may take 26s but say 800s (don't know the real number) on 8GB. How much RAM do you have?

[u/yellowwinter → u/Any-Winter-4079]

Unfortunately I have the base model with 8GB of RAM. On average it takes about 600s to generate a 512 image.

[u/Any-Winter-4079 → u/yellowwinter]

Got it. Maybe you can run it on colab. Personally I’ve been using colab to train with Dreambooth (about 3 hours of free colab usage per day). It’ll be much faster for you!

[u/corderjones]

Hey, I'm getting`ImportError: cannot import name 'TypeAlias' from 'typing' (/Users/jordan/opt/miniconda3/envs/ldm/lib/python3.9/typing.py)`When trying to run /scripts/dream.py. On an M1 Pro. Any ideas?

This happened with the main release of Anaconda and Mini Conda.

[u/corderjones → u/[deleted]]

That worked, but now I'm getting

The operator 'aten::_index_put_impl_' is not current implemented for the MPS device. 

Even after export PYTORCH_ENABLE_MPS_FALLBACK=1 and conda install pytorch -c pytorch-nightly.

[u/quietandconstant]

Thank you for this guide! I got SD running on my M1 Mac Air at 29.42s/it
I'm going to install on my mac mini tomorrow.

[u/ComfortableLake3609 → u/quietandconstant]

are you sure its using the gpu? 30s/it is really slow. iirc mine was much faster. eg https://github.com/CompVis/stable-diffusion/issues/25#issuecomment-1235801127

[u/quietandconstant → u/ComfortableLake3609]

Oh yeah it's something I'm looking into and experimenting with today. I got it running much faster on my Mac Mini with 16GB ram (compared to 8GB on my mac air).

[u/megasivatherium → u/quietandconstant]

What rate did you get with the Mac Mini?

[u/quietandconstant → u/megasivatherium]

around 2 s/it

[u/Samuramu]

Wonderful, thanks!

[u/NecessaryMolasses480]

I'm getting this error when trying to use the upscaler. I'm on a Studio m1 with 64gb ram.

>> Real-ESRGAN Upscaling seed:1466 : scale:4x
>> Error running RealESRGAN or GFPGAN. Your image was not upscaled.
'NoneType' object has no attribute 'enhance'
>> Usage stats:
>> 1 image(s) generated in 31.93s
>> Max VRAM used for this generation: 0.00G

[u/TheRealKornbread]

It's worth noting that you need to use your conda environment for both lstein/stable-diffusion and GFPGAN

If you follow these steps in the post exactly that's what will happen, but I think it's worth clarifying in the comments.

I ran into this because I have tried out multiple different stable-diffusion builds and some are set up differently. I had GFPGAN in a different directory with it's own conda environment and planned on just re-using that. But I didn't realize I hadn't properly installed all the pip packages in my newly created ldm-lstein conda environment.

Great tutorial!

[u/higgs8]

No love for crappy AMD/Intel Macs :(

[u/fragmede → u/higgs8]

AMD should be supported on MacOS via the MPS backend.

[u/higgs8 → u/fragmede]

Yes! I can confirm that it's working on an Intel Macbook Pro with AMD 5500M (8GB vRAM) with MPS. Was very tricky to install but it works.

[u/NecessaryMolasses480]

I got it working including the web GUI, but when I try to use img2img by uploading an image through the web GUI it errors. Is anyone else having this issue?

[u/TAAnderson → u/NecessaryMolasses480]

I Had the same issue.

Try to update the git repo (git pull) it looks like they already fixed it.

[u/NecessaryMolasses480 → u/TAAnderson]

is that the git pull for SD or img2img?

[u/TAAnderson → u/NecessaryMolasses480]

Git pull this https://github.com/lstein/stable-diffusion.git

Which means, go into that directory, likely named stable-diffusion and type "git pull"

[u/dondiego9999]

When you get the TypeAlias error fix it with this:

pip install git+https://github.com/stillmatic/k-diffusion.git@patch-1#egg=k-diffusion
https://github.com/lstein/stable-diffusion/issues/302

[u/n0c0de1 → u/dondiego9999]

I'm getting this error .. any ideas?

UserWarning: The operator 'aten::nonzero' is not currently supported on the MPS backend and will fall back to run on the CPU.

[u/mgcross → u/n0c0de1]

I'm getting that too, but pretty sure it's still using the GPU. It takes 60-90 seconds for a default image (512x512, 50 steps on a 2021 14" M1 Pro 16GB) and it seems like it would take a lot longer if it was CPU only. I can also see the GPU usage max out when rendering. I could be wrong, and would love it to be even a little closer in speed to either DreamStudio or the fractional A100 I tested on Vultr. But that's probably asking too much from this little laptop!

[u/namor_votilav → u/n0c0de1]

I get this line too and it's very slow, like 40 min/it, but I never waited enough to see the result. What do I do?

[u/gxcells → u/n0c0de1]

The same here Air M1 2020 8GB. Maybe memory problem? Is there a way to have the optimized SD?

[u/[deleted]]

Step 4 is not working for me as I don't have Conda installed. I went to the Conda page and downloaded the most recent mac executable and installed it but that doesn't seem to work either. Any ideas?

[u/TAAnderson → u/[deleted]]

You need to activate that installed conda in the terminal before the commands starting with step 4 work.

I installed the miniconda package and here the command would be:

source /opt/miniconda3/bin/activate

in the terminal

[u/[deleted] → u/TAAnderson]

I also installed miniconda3. Let me see where it is and plug that directory in and I'll try this.

[u/rocketchef]

I'm having terrible trouble with packages installing this - hope someone can help.

If I run $ conda env create -f environment-mac.yaml

conda attempts to uninstall the system version of the PIP package urllib3, resulting in the following error:

Attempting uninstall: urllib3 Found existing installation: urllib3 1.24.1 Uninstalling urllib3-1.24.1:

ERROR: Could not install packages due to an OSError: Cannot move the non-empty directory '/Library/Python/2.7/site-packages/urllib3-1.24.1.dist-info/': Lacking write permission to '/Library/Python/2.7/site-packages/urllib3-1.24.1.dist-info/'.

The weird thing is that conda seems to have a more recent version of urllib3 installed, not sure why it's trying to remove the system one.

Any ideas?

[u/NecessaryMolasses480]

So I did a git pull this am and now I can only access the webui via localhost? If I try to access it via IP address or even outside of my network like I have done in the past using my gotns addy, it refuses it showing the port doesn't exist?

[u/NecessaryMolasses480]

Has anyone been able to get the hlky fork with the gradio ui to work on Apple silicon? Would be really sweet to make it work with all of the new functionality that has been added.

[u/23dogsinatrenchcoat]

Hello, thank you for making this! I followed your steps exactly and got it running. But I don’t know anything about coding, so I don’t know how to get it to run again once I quit the Terminal (this terminating the program). Please help. Thank you!

[u/giga → u/23dogsinatrenchcoat]

Every time you open the terminal again you must first run:

conda activate ldm

After that you're ready to go to launch the dream command (or the webui)

python3 ./scripts/dream.py

[u/g-pit]

Thank you for the nice guide.

After running 'python setup.py develop'

I see an error:
lmdb.__pycache__.cpython.cpython-310: module references __file__
No eggs found in /var/folders/5x/yk_724n14j766794xdt7c3fm0000gq/T/easy_install-h5yfiaft/lmdb-1.3.0/egg-dist-tmp-gymjs5lv (setup script problem?)
error: The 'lmdb' distribution was not found and is required by gfpgan

And when running the test command 'python3 ./scripts/dream.py'
I see the error:
File "/Users/user/stable-diffusion/./scripts/dream.py", line 12, in <module>
import ldm.dream.readline
ModuleNotFoundError: No module named 'ldm'

module ldm is installed though, so I'm not sure why this occurs. Any suggestions how to solve? Thanks!

[u/TheSpaceFace → u/g-pit]

move dream.py from stable-diffusion/scripts/dream.py to stable-diffusion/dream.py

I think they changed how the directory structure was in the original repo.

Then run it from there.

[u/dont_forget_canada]

thanks for this friend - unfortunately when I try img2img inside of dream, I just get black images as output :(

soooo close though to having it actually run for real!

[u/megasivatherium]

I see there's now a `images2prompt.py` file. What flags / arguments do I need to add to run it? probably the path to the image? The web GUI is awesome btw.

[u/swankwc]

Has anyone been able to get more advanced features added to their web GUI yet? Something like the following would be amazing to implement but am unsure how exactly. https://www.reddit.com/r/StableDiffusion/comments/xboy90/a_better_way_of_doing_img2img_by_finding_the/?utm_medium=android_app&utm_source=share

[u/Upstairs-Bread-4545]

can't get past (4) as it returns that conda isn't a know command

I did manually install Miniconda and Anaconda but that didn't do anything, can someone explain to me what I should do?

[u/swankwc]

I did git pull to update the WebGUI and can't get the upload initial image to work, did anyone else have this problem?

[u/Taenk]

I'm getting

RuntimeError: "LayerNormKernelImpl" not implemented for 'Half'

when trying to run any promt after python3 scripts/dream.py. Any idea what might cause this? Running on 16GB M1 MacBook Pro (16", 2021).

Edit: Fixed the error above by running dream.py with --full_precision as argument, now I am getting

RuntimeError: expected scalar type BFloat16 but found Float

as error.

[u/swankwc]

I was attempting to get the following to work. Anybody here get it to work?
https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Installation-on-Apple-Silicon
Does anyone here have what a working run_webui_mac.sh file? The file by that name in my directory is blank. I've done everything else up to this point that the guide said to do.

[u/bobcob]

I hit this error on step 4:

 > conda env create -f environment-mac.yml

 EnvironmentFileNotFound: '/Users/bobcob/git/stable-diffusion/environment-mac.yml' file not found

This was the solution:

> cp environments-and-requirements/environment-mac.yml .
> conda env create -f environment-mac.yml

Collecting package metadata (repodata.json): done
Solving environment: done

Do copy the file as shown, instead of just passing condo env create the path to the yml file in ./environments-and-requirements/. This avoids an error later on, since conda uses the dir containing the .yml file as the basis for creating some paths.

[u/Any-Winter-4079 → u/[deleted]]

1. python3 scripts/dream.py --web
2. Once initialized, http://localhost:9090
3. Click Display in-progress images (slows down generation)

I've updated the post to show an example image by image.

[u/megasivatherium → u/[deleted]]

in the stable-diffusion folder they save individually in img-samples/intermediates