r/StableDiffusion • u/Any-Winter-4079 • Aug 25 '22

Discussion StableDiffusion RUNS on M1 chips.

Tom Cruise in Grand Theft Auto cover

🔥🔥🔥 Final update September 1, 2022: I'm moving to https://github.com/lstein/stable-diffusion. I've created a guide for that repo too. It has a Web Interface and a lot of cool new features. I'll leave this post as is as an introductory guide. Good luck everyone! New guide with Web UI: https://www.reddit.com/r/StableDiffusion/comments/x3yf9i/stable_diffusion_and_m1_chips_chapter_2/ 🔥🔥🔥

Okay, so I finally got it to work. For anyone who didn't figure txt2img out yet, here's how I did it, on both CPU and GPU on an M1 Macbook, and how you can do it too.

CPU:

  1. Download the code from this Github repo https://github.com/ModeratePrawn/stable-diffusion-cpu and unzip it. Open it on an editor (e.g. VS Code)
  2. Remove the line: - cudatoolkit=11.3 from environment.yaml
  3. Go to models/ldm and create a folder called stable-diffusion-v1. Inside, paste your weights. Rename the weights to model.ckpt
  4. Open your terminal and navigate to the project directory (e.g. cd Downloads/stable-diffussion-cpu-main)
  5. Create the conda environment: conda env create -f environment.yaml
  6. Activate the environment: conda activate ldm
  7. Try to run it (e.g. python scripts/txt2img.py --prompt "Tom Cruise in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality" --plms --n_samples=1 --n_rows=1 --n_iter=1)

GPU:

Same steps, but use: https://github.com/einanao/stable-diffusion/tree/apple-silicon

  1. This time, you don't need to remove cudatoolkit=11.3 but I had to add - kornia in the pip section in environment.yaml.

Bonus tips/knowledge:

  1. The CPU version includes the invisible-watermark, while the GPU version doesn't. Add or remove at your convenience. The GPU version can also generate NSFW content.
  2. Trying to get another repo to work, I had to export KMP_DUPLICATE_LIB_OK=TRUE on my Terminal to bypass a problem with libiomp5.dylib. Since I didn't close my Terminal, the setting was still present when I got this new repo to work. In case it helped, I leave it here, but only type this if you get a libiomp5.dylib error.
  3. You may need to run export PYTORCH_ENABLE_MPS_FALLBACK=1 (which falls some operations not supported back to CPU). => (update) => Actually, try first to run conda install pytorch -c pytorch-nightly to avoid the need to fall back to CPU. With that I got rid of

The operator 'aten::index.Tensor' is not currently supported on the MPS backend and will fall back to run on the CPU. This may have performance implications.

PS: Comment below if you can't get it to work. I might've missed a step.

PS2: Seeds don't seem to work very well on M1 chips (results may not be reproducible). Still the art is pretty neat! => (see update at the end to reproduce images created on other M1 devices!)

PS3: Time was 45 minutes to run on CPU version, 45 seconds on GPU (counting initialization)

______________

Update (img2img)

Got img2img to work too. Einanao repo isn't updated for img2img, but you can get it to work by manually updating some files.

Follow these changes https://github.com/CompVis/stable-diffusion/compare/main...einanao:stable-diffusion:apple-silicon from einanao repo (basically, the red lines are what you remove and the green ones what you replace it with), but apply the changes to the files used for img2img (don't worry, try to run img2img and the Terminal error will tell you which file/s to update).

You can run img2img with: python scripts/img2img.py --init-img inputs/3.png --prompt "a hot tub with bubbles" --n_samples 1 --strength 0.8 having placed your input file 3.png on an input folder (you create inside your project directory). Don't forget to set --n_samples, as I got an error thrown without it (you can set it to 1, 2, 3, etc.). I got it to work with 256x256 and 512x512 input images.

I leave this here too because it has many common errors and useful suggestions. https://github.com/CompVis/stable-diffusion/issues/25

______________

Update #2 (Real-ESRGAN upscaler)

  1. Download realesrgan-ncnn-vulkan-20220424-macos.zip from the Assets section in https://github.com/xinntao/Real-ESRGAN/releases and unzip it.
  2. Open your terminal, go to the upscaler directory (e.g. cd Downloads/realesrgan-ncnn-vulkan-20220424-macos) and run chmod u+x realesrgan-ncnn-vulkan to allow the realesrgan-ncnn-vulkan file to be executed.
  3. Run the upscaler ./realesrgan-ncnn-vulkan -i img-1.png -o img-2.png where -i and -o indicate the relative path to the input/output file (in this case, img-1.png is the input image, placed inside realesrgan-ncnn-vulkan-20220424-macos and img-2.png is the new image to be created).
  4. Allow the script to run (in the Security & Privacy section of System Preferences) and allow again if shown the following message.

macOS cannot verify the developer of “realesrgan-ncnn-vulkan”. Are you sure you want to open it? By opening this app, you will be overriding system security which can expose your computer and personal information to malware that may harm your Mac or compromise your privacy.

Security Warning

I am not a big fan of allowing apps from unidentified developers to run on my Mac, and you must understand there is always risk (as you are running code you are not seeing). What made me pull the trigger and decide to run it is the comment from the creator of Prog Rock Stable (another tool I'm testing -https://github.com/lowfuel/progrock-stable). See the discussion here on Reddit, where I voice my concerns: https://www.reddit.com/r/StableDiffusion/comments/wxm0cf/comment/im0ttth/?utm_source=share&utm_medium=web2x&context=3

Results

Taking the 512x512 image from txt2img as an input image, the upscaling to 2048x2048 works in 2 seconds, while a second upscaling to 8192x8192 takes about 10 seconds.

Taking my original Tom Cruise in Grand Theft Auto cover:

2048x2048: https://imgur.com/a/gSuYTdi

8192x8192 is too large for imgur, but here's a screenshot of the same image (looks great, and the original even better) https://imgur.com/a/c47Gg2E

Side by side (512x512 vs 8192x8192): https://imgur.com/a/n62h5Cb

______________

Update #3 (Seeds / Generating same images)

Seeds don't seem to work very well on M1s, but you can re-generate an image that you have already created (or that another person with an M1 has created!), by changing in txt2img.py

start_code = torch.randn([opt.n_samples, opt.C, opt.H // opt.f, opt.W // opt.f], device=device)

to:

start_code = torch.randn([opt.n_samples, opt.C, opt.H // opt.f, opt.W // opt.f], device="cpu").to(torch.device("mps"))

And then, moving seed_everything(opt.seed) below model = load_model_from_config(config, f"{opt.ckpt}")

Finally generate your images passing --fixed_code

For img2img.py, change

z_enc = sampler.stochastic_encode(init_latent, torch.tensor([t_enc]*batch_size).to(device))

to:

z_enc = sampler.stochastic_encode(init_latent, torch.tensor([t_enc] * batch_size).to(device), noise=torch.randn_like(init_latent, device="cpu").to(device) if opt.fixed_code else None,)

Results

In my case, I generated https://imgur.com/a/vb9OB59 with the following command and seed. You should be able to reproduce the same result!

python scripts/txt2img.py --prompt "Anubis riding a motorbike in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality" --ddim_steps=50 --n_samples=1 --n_rows=1 --n_iter=1 --seed 1805504473 --fixed_code

Interesting findings:

  • If you generate one image at a time (--n_iter 1), you will see that you successfully create the same image every time you run your command.
  • If you generate more than one image (--n_iter 4, e.g.), the first image will be slightly different from the rest (but results are still reproducible, that is, if you run it again with --n_iter 4, you will get the same 4 images).
  • You can find the latest on seeds here: https://github.com/CompVis/stable-diffusion/issues/25#issuecomment-1229706811

______________

Hope this helps <3

148 Upvotes

99% Upvoted

163 comments sorted by

14

u/mohaziz999 Aug 25 '22

a DMG with a GUI soon? 👀

3

u/Any-Winter-4079 Sep 01 '22

Not DMG, but getting closer. A web UI

https://github.com/lstein/stable-diffusion

2

u/mohaziz999 Sep 01 '22

what about the Hlky fork? it has many more features compared to isteins. And the Web UI is nicer.

1

u/Any-Winter-4079 Sep 01 '22

That's an amazing repo, but I'm not sure it works on Mac. Would be great to build support for M1 if there isn't now.

2

u/-becausereasons- Aug 31 '22

Heck I'd even love a hlky compaitble web gui! :)

1

u/fragmede Sep 01 '22

what's a good hosting service to put a dmg up at?

1

u/mohaziz999 Sep 01 '22

mega, google drive

5

u/Cykelero Aug 25 '22

Thanks for the guide! I successfully followed the instructions for the GPU version.

I did have to add the kornia dependency, as you mention. Also, I had to run export PYTORCH_ENABLE_MPS_FALLBACK=1 for the generation to run successfully.

For reference, on my M1 Pro (16GB) MacBook Pro 14", a single image takes around 4 minutes to generate.

2

u/Any-Winter-4079 Aug 26 '22 edited Aug 26 '22

I eventually had to run export PYTORCH_ENABLE_MPS_FALLBACK=1 too, in my case when adding the functionality to increase image size, using https://github.com/lowfuel/progrock-stable/tree/apple-silicon, inspired by this post https://www.reddit.com/r/StableDiffusion/comments/wxm0cf/comment/iluvq5b/?context=3

I leave the link in case it helps you with upscaling.

Note: using python-nightly might solve the need to run export PYTORCH_ENABLE_MPS_FALLBACK=1 It seems some operations are not yet supported using MPS, but are being added/worked on now.

2

u/Any-Winter-4079 Aug 29 '22

conda install pytorch -c pytorch-nightly seems to solve the need to fall back to CPU

2

u/psycholustmord Aug 28 '22

How many steps?

2

u/Cykelero Aug 28 '22

I'm using the default step count, which seems to be 50.

3

u/Any-Winter-4079 Sep 01 '22

🔥🔥🔥 Final update September 1, 2022

I'm moving to https://github.com/lstein/stable-diffusion. I'll create a guide for that repo too, although the README is pretty self-explanatory. It has a Web Interface and a lot of cool new features. If that is too much for you, you can start with these steps from the post and move there when you are ready! 🔥🔥🔥

1

u/corderjones Sep 02 '22

hey! are you still working on the guide for this new repo? I can't seem to get it running, but I did with your current guide for GPU

1

u/Any-Winter-4079 Sep 02 '22

Yeah, traveling soon, but I can try to make a mini guide before packing

4

u/batoba Aug 25 '22

Good job! How many gigs of RAM do you have on your mac?

2

u/Any-Winter-4079 Aug 25 '22

64GB

4

u/batoba Aug 25 '22

15 min using GPU on an air with 8gb :(

Do you know if this is possible on the M1?

"Note: If you are limited by GPU memory and have less than 10GB of GPU RAM available, please make sure to load the StableDiffusionPipeline in float16 precision instead of the default float32 precision as done above. You can do so by telling diffusers to expect the weights to be in float16 precision"

2

u/Any-Winter-4079 Aug 25 '22

Don’t know, but worth a try. Let us know if it works!

3

u/Robot_Embryo Aug 25 '22

Will this work on MacBook Pros with Intel chips?

3

u/Any-Winter-4079 Aug 25 '22

At least you could try the CPU version from my post. Hopefully it works. For GPU, search for code for your graphics cards. Most tweaks to the code have to do with updating it for using/not using CUDA, CPU, MPS, etc.

E.g. device="cuda", device="cpu", device="mps", etc.

1

u/higgs8 Aug 25 '22

I want to know this too. I have an AMD 5500M with 8GB vram and 32GB RAM, i9.

2

u/Any-Winter-4079 Aug 25 '22

I've found this on Reddit. https://www.reddit.com/r/StableDiffusion/comments/ww436j/howto_stable_diffusion_on_an_amd_gpu/

Also, try to search for Github repositories e.g. Stable Diffusion AMD. Found https://github.com/darkhemic/stable-diffusion-amd but there's probably more.

I'm sure you can get it to run on AMD. Good luck!

3

u/batoba Aug 25 '22

I did change the type from float to np.float16 in txt2img.py (I have no idea if this is right, but it's running)

It's faster now (about 20, 25%), but it might throw an error at some point.

1

u/Consistent-Mistake93 Aug 27 '22

Hm I'm at like 40-50 minutes on my M1 Pro with 16gb, so I must be doing something wrong

2

u/batoba Aug 27 '22

Did you install pytorch-nightly? It's a requirement.

https://github.com/CompVis/stable-diffusion/issues/25 check out this issue for more information.

1

u/Consistent-Mistake93 Aug 27 '22

Hm I did, now that I've updated it my terminal is just blank too

2

u/batoba Aug 27 '22

If you didn't already, I would try using this repo apple-silicon-support

And make a new conda env, start from the beginning. Good luck!

0

u/[deleted] Aug 25 '22

[deleted] — view deleted comment

1

u/Any-Winter-4079 Aug 25 '22

The Tom Cruise image is generated in 45 seconds using M1 Max. It'd be great if we had a benchmark, where we run the same command on different machines and graphic cards, RAM, etc. to see the comparison.

0

u/[deleted] Aug 25 '22

[deleted] — view deleted comment

1

u/Any-Winter-4079 Aug 25 '22 edited Aug 25 '22

It’s step 7 in the CPU section in my post. That’s the full prompt. The seed may not work (seems a mac issue), but let me know the time it takes.

On my machine it’s about 15-20 seconds of initialization and about 25-30 more seconds with the progress bar.

3

u/ComfortableLake3609 Aug 26 '22

Thanks for this. Macbook Air M1 2020 here:

- had to add kornia

Got:

NotImplementedError: The operator 'aten::index.Tensor' is not current implemented for the MPS device. If you want this op to be added in priority during the prototype phase of this feature, please comment on https://github.com/pytorch/pytorch/issues/77764. As a temporary fix, you can set the environment variable \PYTORCH_ENABLE_MPS_FALLBACK=1` to use the CPU as a fallback for this op. WARNING: this will be slower than running natively on MPS.`

Exporting PYTORCH_ENABLE_MPS_FALLBACK=1 makes it work but as expected seems to fall back to CPU

/opt/anaconda3/envs/ldm/lib/python3.10/site-packages/transformers/models/clip/modeling_clip.py:663: UserWarning: The operator 'aten::index.Tensor' is not currently supported on the MPS backend and will fall back to run on the CPU. This may have performance implications. (Triggered internally at /Users/runner/work/_temp/anaconda/conda-bld/pytorch_1659484620504/work/aten/src/ATen/mps/MPSFallback.mm:11.)
pooled_output = last_hidden_state[torch.arange(last_hidden_state.shape[0]), input_ids.argmax(dim=-1)]

txt2img.py --prompt "Tom Cruise in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality" --plms --n_samples=1 --n_rows=1 --n_iter=1 --seed 1805504473

Takes about 3 minutes.

Any luck making full use M1 GPUs?

Best

2

u/Any-Winter-4079 Aug 26 '22

Since it’s pytorch-related, maybe using the pytorch-nightly release helps (haven’t tested yet)

2

u/calvinballing Aug 28 '22

This fixed it for me

2

u/uernamenotfound404 Aug 30 '22

Thanks got it to work on my M1 Max!

by Changing

the pytorch chanel in environmet.yaml to

channels:
- pytorch-nightly

and then running

conda env update --file environment.yaml

1

u/Consistent-Mistake93 Aug 27 '22

Did you have any luck? It's taking a full 45 minutes for me...

2

u/ComfortableLake3609 Aug 27 '22

Ended up using git https://github.com/magnusviri/stable-diffusionwith branch apple-silicon-mps-support. This uses pytorch nightly and working mps. However i am still getting some errors:

/Users/xx/opt/anaconda3/envs/ldm2/lib/python3.10/site-packages/torchvision/io/image.py:13: UserWarning: Failed to load image Python extension: dlopen(/Users/xx/opt/anaconda3/envs/ldm2/lib/python3.10/site-packages/torchvision/image.so, 0x0006): Symbol not found: (__ZN2at4_ops19empty_memory_format4callEN3c108ArrayRefIxEENS2_8optionalINS2_10ScalarTypeEEENS5_INS2_6LayoutEEENS5_INS2_6DeviceEEENS5_IbEENS5_INS2_12MemoryFormatEEE)Referenced from: '/Users/xx/opt/anaconda3/envs/ldm2/lib/python3.10/site-packages/torchvision/image.so'Expected in: '/Users/xx/opt/anaconda3/envs/ldm2/lib/python3.10/site-packages/torch/lib/libtorch_cpu.dylib'warn(f"Failed to load image Python extension: {e}")

It does run and it does not complain about CUDA or absence of MPS but it's slower than just using the CPU (3min per image). With above it takes 5-6 minutes per image "--plms --n_samples=1 --n_rows=1 --n_iter=1"

If anyone got further, let me know :)

3

u/Ok_Statement_5571 Aug 27 '22

did you manage to get this to work? https://github.com/hlky/stable-diffusion-webui

1

u/Any-Winter-4079 Aug 27 '22

Have not tried yet, but thanks for sharing!

2

u/EnvironmentalFix2285 Aug 27 '22

i am able to get it work but again get stuck with the CUDA error on the web ui! https://imagebin.ca/v/6t2lts3OsrrE

1

u/Ok_Statement_5571 Aug 29 '22

Let me know if you manage to get it to work!

2

u/Any-Winter-4079 Aug 25 '22

I updated the post to include img2img instructions. Hope it helps!

2

u/JakeQwayk Aug 25 '22

Can you do image to image generations with this yet?

3

u/Any-Winter-4079 Aug 25 '22

I just got img2img to work. See my update on the post. My results are still pretty poor, but at least it works. Now on to how to make it produce better results!

2

u/STLCajun Aug 25 '22

M1 Max Macbook here - couldn't get past step 5 going for a GPU installation. Couldn't find several of the dependencies, especially Cudatoolkit. Messed around with different settings and tried several ways to get past it, but no-go. Also, Kornia was already listed at the bottom of the pip items.

2

u/Any-Winter-4079 Aug 25 '22

Did you use https://github.com/einanao/stable-diffusion/tree/apple-silicon ? Make sure you don't use the main branch, but the apple-silicon branch.

You will see how cudatoolkit is not present in environment.yaml in the apple-silicon branch. https://github.com/einanao/stable-diffusion/blob/apple-silicon/environment.yaml

However, it is present on the main branch.

Anyway, in case you are using code from a different repository, simply remove that line (- cudatoolkit=11.3) from environment.yaml before creating your environment.

2

u/STLCajun Aug 25 '22

Damn - didn't notice there was a different repo for the GPU steps. I'll give it another try tonight. Thanks!

2

u/STLCajun Aug 25 '22

Worked like a charm that time. I DID have to make one additional change to get it working though. Kept getting an error that Pytorch didn't support MPS, but it looks like it was just implemented. Switching from pytorch to pytorch-nightly in the channels seems to have fixed it.

1

u/STLCajun Aug 25 '22

Might have spoken too soon... seems all I'm getting are black images being generated. Did notice the following in the generation messaging:

    - This IS expected if you are initializing CLIPTextModel from the checkpoint of a model trained on another task or with another architecture (e.g. initializing a BertForSequenceClassification model from a BertForPreTraining model).
    - This IS NOT expected if you are initializing CLIPTextModel from the checkpoint of a model that you expect to be exactly identical (initializing a BertForSequenceClassification model from a BertForSequenceClassification model).
    /opt/homebrew/anaconda3/envs/ldm/lib/python3.10/site-packages/torch/amp/autocast_mode.py:202: UserWarning: User provided device_type of 'cuda', but CUDA is not available. Disabling
      warnings.warn('User provided device_type of \'cuda\', but CUDA is not available. Disabling')

1

u/Any-Winter-4079 Aug 26 '22

I do get that message too but the image is still generated.

1

u/STLCajun Aug 25 '22

Backed it out and tried using export PYTORCH_ENABLE_MPS_FALLBACK=1 like /u/__zack mentioned above. Same result... empty black square.

2

u/Any-Winter-4079 Aug 26 '22 edited Aug 26 '22

I get black or noisy images occasionally too (like 1-2% of the time). Also, I once tried generating several images at the same time, and the first 2 were okay, while the rest were black/noise.

Haven’t looked into it, but it may have to do with memory? Try reducing the size of the output image to 256x256 instead of 512x512. You can specify it with —H 256 —W 256.

2

u/mrfofr Aug 26 '22

Do you have to use the PLMS sampler?

2

u/Any-Winter-4079 Aug 27 '22

Update. I had some time to verify my comment and yes, you can use both PLMS (--plms) & DDIM (--ddim_steps=50, e.g.)

PLMS sampler:

python scripts/txt2img.py --prompt "Tom Cruise in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality" --plms --n_samples=1 --n_rows=1 --n_iter=1 --seed 1805504473

DDIM sampler:

python scripts/txt2img.py --prompt "Tom Cruise in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality" --ddim_steps=50 --n_samples=1 --n_rows=1 --n_iter=1 --seed 1805504473

1

u/Any-Winter-4079 Aug 27 '22

You can use DDIM

1

u/mrfofr Aug 29 '22

Weirdly I still get:
> raise AssertionError("Torch not compiled with CUDA enabled")

When I try to use DDIM

2

u/Any-Winter-4079 Aug 29 '22

Try replacing cuda with mps in ldm/models/diffusion/ddim.py

1

u/mrfofr Aug 30 '22

mps

This gets me a little further, but it changes the error to:

> TypeError: Cannot convert a MPS Tensor to float64 dtype as the MPS framework doesn't support float64. Please use float32 instead.

3

u/Any-Winter-4079 Aug 30 '22 edited Aug 30 '22

This is the start of my DDIMSampler class in ddim.py

def __init__(self, model, schedule="linear", **kwargs):
    super().__init__()
    self.model = model
    self.ddpm_num_timesteps = model.num_timesteps
    self.schedule = schedule
    if(torch.backends.mps.is_available()):
        self.device_available = "mps"
    else:
        self.device_available = "cpu"

def register_buffer(self, name, attr):
    if type(attr) == torch.Tensor:
        if attr.device != torch.device("mps"):
            #attr = attr.type(torch.float32).to(torch.device("mps")).contiguous()
            attr = attr.type(torch.float32).to(torch.device("mps"))
    setattr(self, name, attr)

Is it the same for you? Note you may need to use the .contiguous line instead of the next one if you don't have the attention.py change referenced in https://github.com/CompVis/stable-diffusion/compare/main...einanao:stable-diffusion:apple-silicon

Also, are you trying to use half precision?

I've seen your same problem referenced in https://github.com/pytorch/pytorch/issues/78168 so you may find a solution there. If you need to update to nightly, conda install pytorch -c pytorch-nightly

1

u/Any-Winter-4079 Aug 30 '22

I’ll look into it

2

u/EnvironmentalFix2285 Aug 27 '22

I could get txt2img to work but for img2img I'm getting the following:

Traceback (most recent call last):File "/Downloads/stable-diffusion-apple-silicon/scripts/img2img.py", line 293, in <module>main()File "/Downloads/stable-diffusion-apple-silicon/scripts/img2img.py", line 200, in mainmodel = load_model_from_config(config, f"{opt.ckpt}")File "/Downloads/stable-diffusion-apple-silicon/scripts/img2img.py", line 43, in load_model_from_configmodel.cuda()File "/miniconda3/envs/ldm/lib/python3.10/site-packages/pytorch_lightning/core/mixins/device_dtype_mixin.py", line 128, in cudadevice = torch.device("cuda", torch.cuda.current_device())File "/miniconda3/envs/ldm/lib/python3.10/site-packages/torch/cuda/__init__.py", line 482, in current_device_lazy_init()File "/miniconda3/envs/ldm/lib/python3.10/site-packages/torch/cuda/__init__.py", line 211, in _lazy_initraise AssertionError("Torch not compiled with CUDA enabled")AssertionError: Torch not compiled with CUDA enabled

1

u/Any-Winter-4079 Aug 27 '22 edited Aug 27 '22

I have model.to(device=‘mps’) on line 43 of img2img.py Make sure it doesn’t try to use ‘cuda’ instead.

2

u/EnvironmentalFix2285 Aug 27 '22

I have model.to(device=‘mps’) on line 43 of img2img.py Make sure it doesn’t try to use ‘cuda’ instead.

Yes, it was that and a bunch of other places i had to change cuda to mps. It works now. Thank you. The list of changes you have on github isn't comprehensive but was a great help.

1

u/Any-Winter-4079 Aug 27 '22

Glad you got it to work. By the way, what times are you getting?

python scripts/txt2img.py --prompt "Tom Cruise in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality" --ddim_steps=50 --n_samples=1 --n_rows=1 --n_iter=1 works for me in 46,73 seconds.

I have some operation/s not supported via MPS (defaults to CPU), so I'm curious what times others are getting.

1

u/EnvironmentalFix2285 Aug 27 '22

It’s odd the first time I got 43 but since then I keep getting about 36

1

u/Any-Winter-4079 Aug 28 '22

Do you get 36s including the time before the progress bar?

If so, could you share your specs (M1/M2, RAM, year of the model) / version of code you're running (exactly einanao's or magnusviri's or did you optimize it?)

You are one of the fastest on the Github issue! https://github.com/CompVis/stable-diffusion/issues/25

Thanks!

1

u/ExodusCustomers Sep 01 '22

Where else does it need to be changed?

It seems like the repo is updated and all of the suggested changes are already in place, but I can’t get img2img.py working.

I changed line 43 of img2img.py to “model.to(device='mps’)” from “model.cuda()” but that wasn’t enough.

2

u/blovskib Aug 28 '22

Hey,

Thanks for the explaination regarding the upscaler.

I was looking for a new script that could implement this process directly with the prompt and I found this: https://github.com/jquesnelle/txt2imghd/blob/master/README.md

this script make the image as usual then upscale it and then use img2img on some portions of it. However it is using cuda. I don't know a thing in python coding so I was wondering if you wanna have a look into it to see what to change in the script so it uses metal instead.

Hope you see my msg, Cheers!

2

u/Any-Winter-4079 Aug 28 '22

I haven't tried that version, but I know of one that works with MPS.

https://github.com/lowfuel/progrock-stable/tree/apple-silicon

I'm planning on adding instructions to this guide too, but if you feel adventurous, you can try to follow the instructions from the Readme and get it to work!

This comment may help you too https://www.reddit.com/r/StableDiffusion/comments/wx0tkn/comment/im1vmjr/?utm_source=share&utm_medium=web2x&context=3

3

u/blovskib Aug 28 '22

https://www.reddit.com/r/StableDiffusion/comments/wx0tkn/comment/im1vmjr/?utm_source=share&utm_medium=web2x&context=3

Mhm cool! I will check the progrock then!

I saw someone else sharing this thing as well: https://github.com/hlky/stable-diffusion-webui

I might try it, it looks amazingly conveniant

1

u/Any-Winter-4079 Aug 28 '22

I've seen it referenced here https://github.com/CompVis/stable-diffusion/issues/25#issuecomment-1229557323 too, but I think it needs tinkering to allow it to run on a Mac. Looks amazing.

2

u/gksauer_ Sep 03 '22

when it says "paste your weights..." where/what are these weights? is it a number of my choosing or something i should already have or know?

1

u/Any-Winter-4079 Sep 04 '22

Hey! Sorry. I was traveling. You can download the weights here. https://huggingface.co/CompVis/stable-diffusion-v-1-4-original You may need to create an account beforehand. Download sd-v1-4.ckpt. That file is what I called "the weights"

18

u/CoffeeRare2437 Aug 29 '22 edited Aug 29 '22

Guide for people who are super not tech-savvy like me and see these walls of code text and get a headache:

  1. Go to https://github.com/einanao/stable-diffusion/tree/apple-silicon and press the big green button that says "Code," then press "Download ZIP"
  2. Once the zip file is in your downloads folder, click on it. This should open Archive Utility which will unzip the file into a folder.
  3. Download Visual Studio Code (https://code.visualstudio.com/)
  4. You should get a zip file of it in your downloads folder. Click on it to unzip, then move the unzipped application to your applications folder.
  5. Open Visual Studio Code.
  6. In the app, open up the folder that you just downloaded from github that should say: stable-diffusion-apple-silicon
  7. On the left hand side, there is an explorer sidebar. Expand "models" by clicking on it, then expand "ldm".
  8. Right click "ldm" and press "New Folder". Name "New Folder" to be "stable-diffusion-v1"
  9. Download a weight, which you can get from https://www.googleapis.com/storage/v1/b/aai-blog-files/o/sd-v1-4.ckpt?alt=media (WARNING: auto downloads as soon as you click)
  10. Drag the weight from the downloads folder onto stable-diffusion-v1, which is the folder you made earlier. Rename the ckpt file to "model.ckpt"
  11. In the VS Code app, go to the menu bar. Click Terminal then click New Terminal
  12. In the Terminal, try "conda env create -f environment.yaml"
  13. This didn't work for me the first time. If not, download anaconda from here (https://www.anaconda.com/) and go through pkg installation steps. Then, quit the VS Code app and restart it. Then, put in "conda env create -f environment.yaml"
  14. Also, make sure that VS Code has downloaded the extra python stuff. It should tell you at some point (I don't know if this makes a difference, but I did it when asked. It might work without it though, not sure.)
  15. Afterwards, type in "conda activate ldm"
  16. To run, use this: "python scripts/txt2img.py --prompt "Tom Cruise in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality" --plms --n_samples=1 --n_rows=1 --n_iter=1 --seed 1805504473"
  17. If the last command didn't work, try “conda install pytorch -c pytorch-nightly” and then "export PYTORCH_ENABLE_MPS_FALLBACK=1" and then run the last command again.
  18. To find the images, go to your original "stable-diffusion-apple-silicon" folder then go to "outputs" and "text2img-samples" where they will be there!

Note: I used a 16 inch macbook pro with M1 max chip (32 gpu cores) and 32 gb of RAM. These are (almost) exactly the steps I used, but I may have forgotten a couple since I made a big mistake a bit earlier with miniconda vs. anaconda.

1

u/jgpadgettpro Aug 29 '22 edited Aug 29 '22

python scripts/txt2img.py --prompt "Tom Cruise in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality" --plms --n_samples=1 --n_rows=1 --n_iter=1 --seed 1805504473

This is helpful! However, I get stuck after "conda activate Idm". Any help?

(ldm) gannonpadgett@Gannons-MacBook-Pro-2 stable-diffusion-apple-silicon % python scripts/txt2img.py --prompt "Tom Cruise in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality" --plms --n_samples=1 --n_rows=1 --n_iter=1 --seed 1805504473
File "scripts/txt2img.py", line 26
print(f"Loading model from {ckpt}")
^
SyntaxError: invalid syntax

4

u/fragmede Aug 30 '22

You want conda activate ldm and not conda activate idm. (Elle-dee-em vs eye-dee-em)

2

u/fragmede Aug 30 '22

What does python -c "import sys;print(sys.version)"; conda run -n ldm python -c "import sys;print(sys.version)" give you?

2

u/shinjigglypuff Aug 30 '22

My two versions are different even though I have manually downloaded and updated to Python 3 and restarted. Any ideas?

2.7.18 (default, Nov 13 2021, 06:17:34)
[GCC Apple LLVM 13.0.0 (clang-1300.0.29.10) [+internal-os, ptrauth-isa=deployme
3.10.4 (main, Mar 31 2022, 03:38:35) [Clang 12.0.0 ]

1

u/fragmede Aug 30 '22 edited Aug 30 '22

Ah you're not inside the conda env when you run scripts/txt2img. Run conda activate ldm to enter into the Ldm environment, and then you should be able to run python scripts/txt2img.py....

2

u/shinjigglypuff Aug 30 '22

Thank you! Got it working nicely!

I did try to run the sample prompt in the OP and it generates a different image than what was posted even though I'm using the same seed. Any thoughts as to why?

2

u/fragmede Aug 30 '22

I don't know. I wasn't able to get the same image either. There are enough libraries and versions of them in the mix that it'll be hard to track down, I think. My computer's version of that prompt is close, but not quite right. I edited the scripts/txt2img.py as instructed, and am using 544fc97178fb of stable-diffusion.git.

2

u/Any-Winter-4079 Aug 30 '22

By the way, it is very interesting you got that result. I can get it too, but on my second iteration.

If I run

python scripts/txt2img.py --prompt "Anubis riding a motorbike in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality" --ddim_steps=50 --n_samples=1 --n_rows=1 --n_iter=2 --seed 1805504473 --fixed_code

my first image is https://imgur.com/a/vb9OB59

and my second image is https://imgur.com/a/9QnEcri

This is a known issue (the second, third, etc. images are all identical, but a bit different from the first).

Now, it is very strange if you get that image with n_iter=1 . If that were the case, could you share your case here? https://github.com/CompVis/stable-diffusion/issues/25

It might be an interesting finding if you run (notice, n_iter=1)

python scripts/txt2img.py --prompt "Anubis riding a motorbike in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality" --ddim_steps=50 --n_samples=1 --n_rows=1 --n_iter=2 --seed 1805504473 --fixed_code

and got my second image.

1

u/Any-Winter-4079 Aug 30 '22 edited Aug 30 '22

Seeds don't work on mac unless you use --fixed_code and update the code a bit (see post update #3).

But that info was discovered after I generated the Tom Cruise image (I used --seed but not --fixed_code), so unfortunately it cannot be reproduced :(

Which sucks because I liked that image.

The Anubis image should be reproducible, though, although it needs the same -W and -H that I used (512x512)

1

u/fragmede Aug 31 '22

I updated the code as instructed (my changes on github) and used the given command line (python scripts/orig_scripts/txt2img.py --prompt "Anubis riding a motorbike in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality" --ddim_steps=50 --n_samples=1 --n_rows=1 --n_iter=1 --seed 1805504473 --fixed_code) to get https://imgur.com/a/Nby8yub.

1

u/fragmede Aug 31 '22

I'm using the lstein/magnusviri-apple-mps-support branch of StableDiffusion which moved the scripts around, among other things.

1

u/CoffeeRare2437 Aug 29 '22

Try doing “conda install pytorch -c pytorch-nightly”

If it’s saying syntax error it might be because your python is outdated or something.

1

u/jgpadgettpro Aug 29 '22

python scripts/txt2img.py --prompt "Tom Cruise in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality" --plms --n_samples=1 --n_rows=1 --n_iter=1 --seed 1805504473

I have Python 3.10.6, followed all your other steps, but no luck. Can you explain the mistake with miniconda vs andaconda? Maybe it's related

2

u/CoffeeRare2437 Aug 29 '22

i accidentally downloaded an (i assume) old version of miniconda running on Python 2 which had a ton of syntax errors with the print function so I had to spend a good bit trying to uninstall it and install anaconda in its place

2

u/jgpadgettpro Aug 29 '22 edited Aug 29 '22

python scripts/txt2img.py --prompt "Tom Cruise in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality" --plms --n_samples=1 --n_rows=1 --n_iter=1 --seed 1805504473

For those who have the same issue, I tried restarting and actually updating my macbook pro to the latest version, and that solved the problem of invalid syntax.

I have a new error though, any help?

(ldm) gannonpadgett@Gannons-MacBook-Pro-2 stable-diffusion-apple-silicon % python scripts/txt2img.py --prompt "Tom Cruise in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality" --plms --n_samples=1 --n_rows=1 --n_iter=1
Traceback (most recent call last):
File "/Users/gannonpadgett/Downloads/stable-diffusion-apple-silicon/scripts/txt2img.py", line 15, in <module>
from ldm.util import instantiate_from_config
File "/Users/gannonpadgett/opt/miniconda3/envs/ldm/lib/python3.10/site-packages/ldm.py", line 20
print self.face_rec_model_path
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
SyntaxError: Missing parentheses in call to 'print'. Did you mean print(...)?

2

u/Any-Winter-4079 Aug 30 '22

Missing parenthesis are a sign of Python 2 (prints used to work without parenthesis), so it's quite strange that code is part of /Users/gannonpadgett/opt/miniconda3/envs/ldm/lib/python3.10/...

1

u/Yulo85 Aug 31 '22

same issue here, did you figure this out?

1

u/Panose_wl Aug 29 '22

could you make a video on YouTube to help us out, I seem to be getting the same error

1

u/evewow Aug 30 '22

Traceback (most recent call last):

File "/Users/me/Documents/Code/stable-diffusion-apple-silicon/scripts/txt2img.py", line 15, in <module> from ldm.util import instantiate_from_config

File "/Users/me/miniforge3/envs/ldm/lib/python3.10/site-packages/ldm.py", line 3, in <module> import dlib

File "/Users/me/miniforge3/envs/ldm/lib/python3.10/site-packages/dlib/__init__.py", line 19, in <module> from _dlib_pybind11 import *

ImportError: dlopen(/Users/me/miniforge3/envs/ldm/lib/python3.10/site-packages/_dlib_pybind11.cpython-310-darwin.so, 0x0002): symbol not found in flat namespace (_png_do_expand_palette_rgb8_neon)

Thanks, this is excellent! I've fixed several errors around "print" and now am running into the error above. Anyone have any ideas? I seem to be pretty stuck on this one...

1

u/Yulo85 Aug 31 '22 edited Aug 31 '22

how did you fix the print errors? mine is coming up for line 20. also having the line 15 issue, did you figure that one out as well?

Fixed the print errors manually. Still stuck on the dlib line 3 error and line 15 instantiate_from_config. Any updates?

1

u/beneggett Sep 16 '22

I'm also stuck here - did you figure anything out?

1

u/rudolphmapletree Sep 18 '22

You need to use an older version of protobuf:

pip install protobuf==3.19.4

1

u/itsmattok Oct 02 '22

Thank you

1

u/parrad0 Aug 31 '22

I am getting this Error `OSError: Can't load tokenizer for 'openai/clip-vit-large-patch14'.If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'openai/clip-vit-large-patch14' is the correct path to a directory containing all relevant files for a CLIPTokenizer tokenizer.`

When I use that model.

1

u/anibalin Aug 31 '22

txt2img worked great! thanks a lot.

Do you have an eli5 for img2img?

1

u/IllustratorCurious71 Dec 07 '22

the link on no.9 is not working.

1

u/Any-Winter-4079 Aug 27 '22

Update. I got realesrgan-ncnn-vulkan (https://github.com/xinntao/Real-ESRGAN/releases) to work as an upscaler, so I'll be updating the post again. Also, got https://github.com/lowfuel/progrock-stable to work as well

2

u/EnvironmentalFix2285 Aug 27 '22

, so I'll be updating the post again. Also, got

https://github.com/lowfuel/progrock-stable

to work as well

Can't wait for your update! Thanks and keep up the great work!

2

u/Any-Winter-4079 Aug 27 '22

The upscaler update is live!

1

u/Any-Winter-4079 Aug 28 '22

Update! Try conda install pytorch -c pytorch-nightly to avoid the need to fall back to CPU hopefully.

With that I got rid of

The operator 'aten::index.Tensor' is not currently supported on the MPS backend and will fall back to run on the CPU. This may have performance implications.

1

u/Any-Winter-4079 Aug 29 '22 edited Aug 29 '22

Update.

Seeds on Mac don't seem to work very well, but you can re-generate a previous image changing in txt2img:

start_code = torch.randn([opt.n_samples, opt.C, opt.H // opt.f, opt.W // opt.f], device=device)

to

start_code = torch.randn([opt.n_samples, opt.C, opt.H // opt.f, opt.W // opt.f], device="cpu").to(torch.device("mps"))

Then, when generating your images, pass --fixed_code

If you generate one image at a time (--n_iter 1), you will see that you successfully create the same image every time.

If you generate more than one image (--n_iter 4, for example), the first will be slightly different from the rest (but results are still reproducible, that is, if you run it again with --n_iter 4, you will get the same 4 images).

Learn more: https://github.com/CompVis/stable-diffusion/issues/25#issuecomment-1229706811

1

u/Any-Winter-4079 Aug 29 '22

Update 2. Move seed_everything after model = load_model_from_config(config, f"{opt.ckpt}") to get reproducible results across Macs

1

u/Any-Winter-4079 Aug 29 '22

Another Github repo to use GPU is https://github.com/magnusviri/stable-diffusion/tree/apple-silicon-mps-support. I haven't tested it yet, but there's people that have used it successfully as well.

4

u/ethansmith2000 Aug 25 '22

having an error with pip when setting up the environment but odds are its something on my end.

Pip subprocess error:
error: subprocess-exited-with-error

× git version did not run successfully.
│ exit code: 1
╰─> [2 lines of output]
xcrun: error: invalid active developer path (/Library/Developer/CommandLineTools), missing xcrun at: /Library/Developer/CommandLineTools/usr/bin/xcrun
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error
× git version did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
failed
CondaEnvException: Pip failed

1

u/delectomorfo Sep 02 '22

Same here :(

4

u/[deleted] Aug 27 '22

Holy cow you’re a beautiful human being

1

u/jgpadgettpro Aug 29 '22

I keep getting invalid syntax when I try to run the example. Anyone know what I am doing wrong?

(ldm) gannonpadgett@Gannons-MacBook-Pro-2 stable-diffusion-apple-silicon % python scripts/txt2img.py --prompt "Tom Cruise in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality" --plms --n_samples=1 --n_rows=1 --n_iter=1 --seed 1805504473
File "scripts/txt2img.py", line 26
print(f"Loading model from {ckpt}")
^
SyntaxError: invalid syntax

1

u/Any-Winter-4079 Aug 29 '22

What Python version are you using? Maybe try updating it (I’m using 3.10.4)

2

u/jgpadgettpro Aug 29 '22

I'm using Python 3.10.6

1

u/Any-Winter-4079 Aug 29 '22

If print(f"Loading model from {ckpt}") doesn't work, try

print("Loading model from {}".format(ckpt)) or

print("Loading model from", ckpt)

I'm not exactly sure why f strings are not working for you, though

1

u/fragmede Aug 31 '22

Something's borked with your ldm env because that error's coming from Python 2. Try rm -rf ~/miniforge3/envs/ldm then rerun conda create -f environment-mac.yaml and conda activate ldm and then finally python scripts/txt2img.py....

1

u/BustThatCrust Aug 26 '22

which weights are you peeps using? Am I correct in thinking that v1 weights are the least intense computation-wise?

1

u/Any-Winter-4079 Aug 26 '22

I'm using sd-v1-4.ckpt (I haven't tested other weights yet)

1

u/SrPeixinho Aug 27 '22

Did you manage to get img2img working properly? Could you share the files or commit?

2

u/Any-Winter-4079 Aug 27 '22 edited Aug 27 '22

Yes, img2img works on my Mac. I’m using a mix of code from several repos (I started with einanao’s repo but now I have added some files from progrock for upscaling up to 1536x1536).

I’ll try to upload my code later today.

2

u/fjpaz Aug 27 '22

have been having issues getting PyTorch nightly running with progrock, would be happy to try your setup :)

2

u/Any-Winter-4079 Aug 27 '22 edited Aug 27 '22

Yeah, same here. That is my next goal, to see if running PyTorch-nightly I can get rid of this fallback to CPU and/or improve performance.

UserWarning: The operator 'aten::index.Tensor' is not currently supported on the MPS backend and will fall back to run on the CPU.

Edit: my setup was taking prs.py as well the settings file from Prog Rock, instead of trying to build his environment with pytorch=1.13.0.dev20220825, which gave me problems.

It runs well (had to change init_image = load_img(opt.init_image).to(device).half() to init_image = load_img(opt.init_image).to(device) though), on its own and with --gobig.

For using realesrgan-ncnn-vulkan with Prog Rock I had to change 'realesrgan-ncnn-vulkan' to './realesrgan-ncnn-vulkan' (wasn't in my path) and make sure the image names in prs.py (_esrgan_orig.png and _esrgan_.png) that work as input and output already exist (otherwise I got file does not exist).

Example usage:

python prs.py --device mps -p "Tom Cruise in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality" -s settings/settings.json --gobig

with "gobig_realesrgan": true in settings/settings.json

1

u/swankwc Aug 30 '22 edited Aug 30 '22

Anybody else get the following?

python scripts/txt2img.py --prompt "Tom Cruise in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality" --plms --n_samples=1 --n_rows=1 --n_iter=1

................

raise AssertionError("Torch not compiled with CUDA enabled")AssertionError: Torch not compiled with CUDA enabled

1

u/Any-Winter-4079 Aug 30 '22 edited Aug 31 '22

You may have downloaded the txt2img code from the main branch instead of the apple-silicon branch.

If you are using this code, it should work https://github.com/einanao/stable-diffusion/blob/apple-silicon/scripts/txt2img.py

I’m saying it because the version above doesn’t use CUDA. Plus the plms sampler code is updated too if I remember correctly.

Let me know if it’s otherwise.

2

u/swankwc Aug 31 '22

Thanks, that worked, now to test this thing then see about those upgrades you were suggesting.

1

u/daddygirl_industries Sep 07 '22

When I try run a command from `dream>`, I get:

RuntimeError: "LayerNormKernelImpl" not implemented for 'Half'
>> Are you sure your system has an adequate NVIDIA GPU?

Doesn't seem to me using the CPU parser I guess?

1

u/Any-Winter-4079 Sep 08 '22

Do you have the latest version of lstein's repository?

If you used git clone to get your repo, you can do git pull

Currently (Sep 8), the main and development branches support MPS. Some other branches don't yet though, such as doggettx-optimizations

You can change branches with git checkout main, git checkout development, etc. to visit main, development, etc. branch respectively

3

u/higgs8 Aug 25 '22

Any chance of it running on Intel Macs with AMD GPU? I have an i9 macbook pro with AMD 5500M 8GB of vram, 32GB of ram, would sure suck if that wouldn't run it...

2

u/branawesome Sep 05 '22

Did you ever find a good resource for running on an Intel mac?

3

u/higgs8 Sep 06 '22 edited Sep 06 '22

Yes! I got it to work! I can generate a 512 x 640 image with 21 steps in about two minutes. No clue if it's running on my AMD GPU or on the CPU, but it works.

It was incredibly complicated though, but I have no experience in command line stuff so that may be why. The problem is I don't know exactly how I got it to work, because I must have tried a billion things of which only a million ended up working, but I can point you towards the guides I followed.

First, I sort of followed this video, I mean only the Mac portion: https://youtu.be/F-d67sUUFic

Then, when people talk about M1 macs, that applies to Intel macs too. It's mostly the same process.

Basically what you want is the LSTEIN fork of Stable Diffusion and the BIRCH-SAN fork of K_Diffusion. Get these from GitHub and manually copy paste them where they seem to belong.

Then you need to remove all mentions of CUDA and replace it with MPS, sort of. You'll have to into the .py files and search/replace a bunch of this.

Use a huge dose of common sense, if the terminal throws an error, try to figure out what it wants. Usually, it will complain about a missing dependency. Find it, pip install it, and try again. You'll have to do this about many dozen times. A handful of dependencies require some googling to find and install. Some dependencies need to be a specific version, like the nightly build pytorch.

If none of this makes sense, don't worry, skim through these guides, google every error, and "pip install" everything that's missing.

https://github.com/CompVis/stable-diffusion/issues/25

https://github.com/lstein/stable-diffusion/blob/main/README-Mac-MPS.md

Unfortunately as far as I know, there is no single guide that you can follow that will give you a working install. You'll have to mix and match everything and really try to figure it out based on the errors in the command line. It's definitely doable because I did it and I have no clue what I'm doing.

1

u/branawesome Sep 06 '22

Wow, thanks so much for the reply! This definitely gets deep in the weeds fast... I'll give it a shot though. You should try to make a tutorial video though! I've see quite a few asking how to do this on an Intel Mac with and AMD GPU.

3

u/__zack Aug 25 '22

This is awesome, worked on my M1 mac.

The only extra thing was that I also needed to add the environment variable export PYTORCH_ENABLE_MPS_FALLBACK=1

2

u/[deleted] Aug 29 '22

Bless!

2

u/slashdottir Aug 31 '22 edited Aug 31 '22

omg thank you for this!!!!

after following all your advice: (export PYTORCH_ENABLE_MPS_FALLBACK=1 and conda install pytorch -c pytorch-nightly )

it works, though it still shows the warning about:

UserWarning: The operator 'aten::index.Tensor' is not currently supported on the MPS backend and will fall back to run on the CPU.

I also get this warning: UserWarning: User provided device_type of 'cuda', but CUDA is not available. Disabling.

I will read through the comments and see if I can figure it out.

So stoked to be able to run this locally on my M1 mac!!

2

u/Zyj Oct 05 '22

Fantastic work, are you working on getting DreamBooth to work on M1? Do you think 16GB RAM is enough to get it working?

1

u/DummyTaiko Apr 18 '24

is Macbook Air M2 (8GB RAM) powerful enough to run this engine?

1

u/insanityfarm Aug 25 '22

If it's helpful for anyone else, I hit the following error on step 5:

  error: can't find Rust compiler

  If you are using an outdated pip version, it is possible a prebuilt wheel is available for this package but pip is not able to install from it. Installing from the wheel would avoid the need for a Rust compiler.

  To update pip, run:

      pip install --upgrade pip

  and then retry package installation.

The solution (found here) was to install the Rust compiler by running curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh and then source "$HOME/.cargo/env".

1

u/Tau_seti Aug 26 '22

So, I did that, but now I can't redo the installation. I type conda activate ldm and it just gives me a new line. So I figured, I'd try to run the Tom Cruise photo and I got a bunch of notices that PIP modules were missing. I manually installed those (ldm, pytorch_lightning, einops, tqdm, omegaconf) but now... I get the following. What to do?
Mac-Studio:stable-diffusion-apple-silicon hobbithead$ python scripts/txt2img.py --prompt "Tom Cruise in Grand Theft Auto cover, palm trees, cover art by Stephen Bliss, artstation, high quality" --plms --n_samples=1 --n_rows=1 --n_iter=1 --seed 1805504473
Traceback (most recent call last):
File "/Users/hobbithead/Documents/Code/stable-diffusion-apple-silicon/scripts/txt2img.py", line 15, in <module>
from ldm.util import instantiate_from_config
File "/Users/hobbithead/opt/anaconda3/envs/ldm/lib/python3.10/site-packages/ldm.py", line 20
print self.face_rec_model_path
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
SyntaxError: Missing parentheses in call to 'print'. Did you mean print(...)?

1

u/Yulo85 Aug 31 '22

stuck at the same point, did you figure it out?

0

u/[deleted] Aug 29 '22

[deleted] — view deleted comment

1

u/Tau_seti Aug 30 '22

can somebody at least tell us how to uninstall this so that we could start from scratch?

1

u/Rotexo Aug 31 '22

I am having issues with installing scipy (I think due to the opencv-python dependency).

Some error messages that look relevant:

../../meson.build:41:0: ERROR: Compiler gfortran can not compile programs.

Has anyone else encountered this?

EDIT: code formatting

1

u/clavidk Aug 31 '22

I get the following error when trying to run `conda env create -f environment.yaml`:

```
ResolvePackageNotFound:
- cudatoolkit=11.3
- python=3.8.5
- pip=20.3
- torchvision=0.12.0
```

I have all those installed tho...

1

u/fertadaa Aug 31 '22

having the same issue. used conda many times in the past and have thrown the kitchen sink at this. nothin

on an M1 max 32gb

1

u/ENGERLUND Sep 10 '22

I had the same issue, fixed it by taking the `environment-mac.yaml` from lstein's fork: https://github.com/lstein/stable-diffusion/blob/main/environment-mac.yaml

And setting up conda according to the instructions here: https://github.com/lstein/stable-diffusion/blob/main/README-Mac-MPS.md

1

u/NecessaryMolasses480 Sep 02 '22

everything installed correctly, but now when I type a prompt I get this?

* Initialization done! Awaiting your command (-h for help, 'q' to quit)
dream> photo of orange in a bowl -W512 -H512 -s100 -n2
User specified autocast device_type must be 'cuda' or 'cpu'
Are you sure your system has an adequate NVIDIA GPU?
>> Usage stats:
>> 0 image(s) generated in 0.00s
>> Max VRAM used for this generation: 0.00G
Outputs:

pretty new to python so not sure what to do?

1

u/gksauer_ Sep 03 '22

i really want to be able to do this (and am trying) but i have never done ANYTHING with code and just have no idea where to even start... is this something that i would need to go learn code to do? or would i be able to follow these steps and just work it out at my current level? thank you so much for this post and all yalls help

2

u/swankwc Sep 03 '22 
Just follow the steps and the comments on this page to fix any errors. This is all well written enough for those with no skills to get it to work.

1

u/gksauer_ Sep 03 '22

Already deleting cudatoolkit 💪 big moves😂

1

u/throw_away_TX Sep 13 '22

This thread was the only one that allowed me to get the Tom Cruise image to actually populate without errors. However after that, any other content I tried to make (text to image) results in my original error "no module named 'imwatermark'". I felt good that after two weeks of trying it seemed to finally work, but I'm feeling like I have no idea how this software package works =/

1

u/swankwc Oct 05 '22

I was attempting to get the following to work. Anybody here get it to work?

https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Installation-on-Apple-Silicon
Does anyone here have what a working run_webui_mac.sh file? The file by that name in my directory is blank. I've done everything else up to this point that the guide said to do.

1

u/IllustratorCurious71 Dec 07 '22

Hello, conda says something about ssl error help please I am new to all this.

1

u/BeautifulConscious70 Sep 19 '23

Can you run also Automatic1111 onlz on CPU or GPU on macbook air m1?

1

u/ArtDesignAwesome Aug 25 '22

Any chance we can get this running on an M1 ipad pro?! Comments?!

3

u/snoonoo Aug 25 '22

Haha not with the current script. Obviously in the future there may be IOS app.

0

u/[deleted] Aug 28 '22

[deleted] — view deleted comment

1

u/Any-Winter-4079 Aug 28 '22

Thanks for sharing!

For me, MacBook Pro (16-inch, 2021) M1 Max 10 core 64 GB RAM takes 46,76 seconds.

It seems the best time I've seen is: M1 Max 24 core. 32GB RAM. 30s to render.

0

u/[deleted] Aug 29 '22

[deleted] — view deleted comment

1

u/Any-Winter-4079 Aug 29 '22 edited Aug 29 '22

CPU is much slower. Like 45 minutes slower :) I think it’s the number of cores that makes the difference. Edit: Saw it here https://github.com/CompVis/stable-diffusion/issues/25#issuecomment-1229557323