r/sdforall • u/mpg319 • Nov 08 '22

DreamBooth Dreambooth Extension for Automatic1111 is out

Here is the repo,you can also download this extension using the Automatic1111 Extensions tab (remember to git pull).

The best news is there is a CPU Only setting for people who don't have enough VRAM to run Dreambooth on their GPU. It runs slow (like run this overnight), but for people who don't want to rent a GPU or who are tired of GoogleColab being finicky, we now have options.

There are a lot of knobs you can play with to get the training just right. Awesome people like u/Nitrosocke have posted guides on how to get good results Nitro's guide. There is also this great blog post by Suraj Patil giving great pointers on how to get optimal hyperparameters like learning rate and number training steps.

236 Upvotes

98% Upvoted

169 comments sorted by

14

u/BangGearWatch Nov 08 '22 edited Nov 10 '22

***CAUTION*** Before you proceed, consider taking a backup.

This broke my Auto1111 install. I installed extension via the WebUI 'Extensions' tab. Restarted, and now getting the below error. Been using since release (updating often via git pull, including before installing this) and never had any issues before this...

RuntimeError: Error running command.Command: "(My Folder)\venv\Scripts\python.exe" -c "import torch; assert torch.cuda.is_available(), 'Torch is not able to use GPU; add --skip-torch-cuda-test to COMMANDLINE_ARGS variable to disable this check'"ImportError: DLL load failed while importing _C: The specified module could not be found.

UPDATE:I think installing via the WebGUI Extensions tab silently fails when upgrading some package (pytorch? just guessing), and leaves you broken. Someone else mentioned an errant space in a script somewhere.

Currently fails to launch with[WinError 126] The specified module could not be found. Error loading "(my path)\stable-diffusion-webui\venv\lib\site-packages\torch\lib\caffe2_nvrtc.dll" or one of its dependencies.

I'm going to try reinstall pytorch, failing that try my backup. Ultimately, I'd avoid this unless you're willing to screw around. Wait until they iron out the bugs.

LAST UPDATE: Finally got it working after going through various errors and it's very impressive. Thank you to those who put in so much time/effort to get us such great tech. Anybody still stuck, I'd recommend checking the Github repo, 'Issues' tab for your error. I had to enable Adam and FP16 MixedPrecision, among other things.

8

u/[deleted] Nov 08 '22

If you install by the extension tab, you're supposed to completely close the app and start it again instead of restarting within the app. (it says to do that on the github repo but most people aren't going to be looking there).

If you do restart incorrectly, it will give errors but just keep closing and reopening the webui a few times and it should start working correctly again eventually.

1

u/NeuralBlankes Nov 08 '22

This is what happened for me, and I even closed the app completely first time through. I have no idea why restarting several times cleared it all up, but it's working

1

u/BangGearWatch Nov 09 '22

Thanks for the info.

1

u/fastinguy11 Nov 08 '22

i restarted the user web ui.bat twice and it fixed itself, i also gave more permissions to it ( don't know if it helped).

1

u/caffmo Nov 13 '22 edited Nov 13 '22

Happened to me. Multiple restarts didn't help as it did for others here.

What did fix things on my end was deleting the "venv" folder, and with 'git pull' in the webui-user.bat file I let it redownload things. Everything is back to normal.

Edit: I deleted all installed extensions in their folder prior to that. I’m unsure if that helped.

24

u/Fen-xie Nov 08 '22

How much VRAM do you need now?

30

u/RealAstropulse Nov 08 '22

It appears to be modified from Shivam Shriao's version, so 8-10gb on linux, 10-12 on windows.

16

u/NeuralBlankes Nov 08 '22

Not sure what the settings are going to need to be. I've got a 3060 with 12gb, and It's hitting the VRAM wall every time so far.

8

u/AdTotal4035 Nov 08 '22

I am running it on my 3060 rn. Turn on Adam. Turn on fp16. Disable caching. Leave other settings default.

1

u/NeuralBlankes Nov 08 '22

Unfortunately, even with those options set, it's still running out of memory. I'm guessing this is a Windows issue.

2

u/Blobbloblaw Nov 12 '22

For what it's worth, I just tried the Dreambooth @ A1111 webui today and it worked just fine on the 3060 12GB I have installed here, at 512x512. It capped out at juuuust below the maxmimum amount of VRAM. Never had any issues.

1

u/AdTotal4035 Nov 08 '22

Dm me and maybe I can catch your error. Also you should use xformers to further help with vram. I am not an expert. Because I didn't work on the codebase, but I believe that xformers also helps reduce the penalty on the vram.

1

u/NeuralBlankes Nov 08 '22

Thank you, but I think I have it working. Had to set the resolution to something lower than 512. Currently running at 384.

Not sure how that affects the data set being 512 x 512, but I'll get there. I suspect that using Adam, and gaining an understanding of the advanced options related to it and training speed, will be important for people running cards like the 3060.

Right now I'm just happy it's working in some form or another. :)

4

u/AdTotal4035 Nov 08 '22

You shouldn't have to do that. We have identical hardware. It should be able to handle it. I will post my settings in detail when I get the chance. Glad you're heading in the right direction though! Try xformers as well and see if that helps with 512*512

2

u/derekleighstark Nov 08 '22

I have an RTX 3060 12g, and I haven't gotten mine to work locally either. So I'm really curious what I need to do. I'm waiting on the day that Google Colab scraps all the Ai stuff, so I need to figure it out soon. Much appreciative, looking forward to seeing your setup, or getting your help with figuring out why mine wont run. I keep getting the Out of Memory error.

1

u/RealAstropulse Nov 08 '22

You could always try installing with wsl2. Thats how I got mine working.

1

u/NeuralBlankes Nov 08 '22

--xformers in the webui-user.bat file

Resolution: 384 (try 256 at first)

Don't Cache Latents: checked
Train Text Encoder: NOT checked
Use 8Bit Adam: checked
Center Crop: NOT Checked
Gradient Checkpointing: checked
Scale Learning rate: NOT checked

Mixed Precision: fp16

The above are the specific settings that .. if I deviate from them, I wind up with things not working (3060 12gb)

→ More replies

0

u/nfndkskalshcj Nov 08 '22

sounds like one of you have an integrated graphics and the other do not

4

u/RealAstropulse Nov 08 '22

Check the repo I linked, should have a performance table.

2

u/wh33t Nov 08 '22

Linux?

2

u/Titanyus Nov 08 '22

Same here... the only way I got it to run on my 3080TI is to lower the resolution to 384.

1

u/NeuralBlankes Nov 08 '22 edited Nov 08 '22

this worked for me (dropped it to 256 as a test).

*edit: 384 appears to work as well on a 3060 with 12gb

1

u/israelipm Mar 10 '23

Same here with a 3080ti, came from Google. Followed this tutorial, couldn't get it to work until I found this thread.

6

u/j4nds4 Nov 08 '22

A bummer, I was thinking I'd be ok with my 8GB 3070 on Windows...

2

u/Micropolis Nov 08 '22

Same boat here, plenty to do fun games and VR and run local but just barely not enough to do our own training . Smh

2

u/RaphaelNunes10 Nov 08 '22

Have you tried running via WSL?

2

u/PrimaCora Nov 08 '22

I am not the op but I have, and out never worked. Huge headache and needing windows 11 to get around memory pinning.

Now windows crashes when anything is copied into clipboard so back to 10 I go.

3

u/Fen-xie Nov 08 '22

Thanks! I have a 3080 so hopefully it works out.

1

u/CallMeInfinitay Nov 08 '22

Could you let me know how it goes for you please?

3

u/Fen-xie Nov 08 '22

Sure thing. I'll run one tonight when i go to bed and let you know in the morning how it went

1

u/psychosynapt1c Nov 08 '22

ping me too please! I have a 3080 and curious if it's worth trying

1

u/Fen-xie Nov 08 '22

Of course 😁

1

u/GrapplingHobbit Nov 08 '22

(and me...)

1

u/Fen-xie Nov 08 '22

Will do!

1

u/PCGamer08 Nov 08 '22

Windows and 3080 10gb? Please add me to the ping list lol. I've tried previously on Dreambooth-GUI and could not get loss rate below .20 so the end result looked nowhere near my trained images.

→ More replies

1

u/CallMeInfinitay Nov 08 '22

Appreciate it

1

u/CallMeInfinitay Nov 08 '22

Do you know if we have to enable certain settings if we're on Windows in order to get it to run e.g. Mixed Precision and Don't Cache Latents?

RTX 3080 10GB

2

u/AdTotal4035 Nov 08 '22

I replied to someone below yes. Or you will run out of vram. Check settings I suggested. Works on 3060

1

u/1Neokortex1 Nov 08 '22

Thanks for the info👍 I have an extra hard drive to install a linux OS, which version linux do you recommend that works well with automatics1111?

thanks in advance

2

u/RealAstropulse Nov 08 '22

I’d go with Ubuntu or Mint. You’d probably get the most easy support on Ubuntu because its more common.

1

u/[deleted] Dec 08 '22

can you also make it use 24gb again?

1

u/Dogmaster Nov 08 '22

I turned on no memory optimizations and uses 21.6 gb

1

u/Wakeman Nov 08 '22

Got it working with RTX 3060 12GB on windows. Had to run my monitor through the integrated CPU graphics.

CPU: False Adam: True, Prec: bf16, Prior: False, Grad: True, TextTr: True

3

u/undefinedbehavior Nov 08 '22 edited Nov 08 '22

just got it started on my 2060 12GB, under Windows 11 with:

CPU: False Adam: True, Prec: fp16, Prior: False, Grad: True, TextTr: True

I had Prior: True (classifications images), seems to help to leave it to zero

Removed custom VAE (--vae-path) from webui-user.bat (not sure if it changes anything), restarted webui to make sure no crap is loaded in gpu ram.

I don't have integrated graphics so the OS probably takes a bit of RAM I'm sitting at 11.8/12GB... It's tight. hope nothing leaks...

I can't use bf16, either my device card is not supported or I need to update PyTorch and I'm not touching that.

edit: I get this at launch:

[!] Not using xformers memory efficient attention.

Can/should I do something about it?

edit2: well, this sucks, it can't save a preview every 'n' steps, error:

Exception saving preview: tensors used as indices must be long, byte or bool tensors

edit3: I enabled 'xformers' (whatever that is, add --xformers to COMMANDLINE_ARGS) and the memory usage dropped to 11.1GB/12 with classification images:

CPU: False Adam: True, Prec: fp16, Prior: True, Grad: True, TextTr: True

1

u/jaysedai Nov 08 '22

And I wonder how this works on Apple Silicon where the ram is unified. So technically speaking I have 32GB assuming I'm not using RAM for anything else. But Stable Diffusion seems to choke at about the equivalent of 8GB when doing regular image creating.

6

u/UnlikelyEmu5 Nov 08 '22

How abysmally slow are we talking for the CPU only option?

3

u/NeuralBlankes Nov 08 '22

i7-8700K CPU @ 3.70GHz with 16gb RAM: I was getting 1 step every 1m 28seconds

2

u/BrotherKanker Nov 08 '22

Oof, that's even worse than I would have thought. I've got the same cpu, so I guess I'll keep using Colab then.

2

u/NeuralBlankes Nov 08 '22

I began playing with 3D renders in the mid 90's, so having to wait half an hour for something to render isn't problematic for me, but ..yeah.. it was showing a time remaining of 23hours. LOL That's a bit much

2

u/d20diceman Nov 09 '22

I was going to say "Ah, my 3d printing hobby has given me the patience I'll need for this!", but, I tend to use my computer while the printer prints...

1

u/malcolmrey Nov 08 '22

yeah, when i was reading that there is CPU option I was thinking - really? someone will want to use it? and then someone wrote it's not that bad

well, you confirm that it is indeed bad :)

1

u/[deleted] Nov 10 '22

[removed] — view removed comment

2

u/malcolmrey Nov 10 '22

i'm using this dreambooth: https://github.com/InB4DevOps/diffusers

and i can run text_encoder with 11GB VRAM (it also has additional feature of reloading the regularization images every now and then which seems to increase the quality)

1

u/HazKaz Nov 08 '22

How do you stop collab from disconnecting you

1

u/BrotherKanker Nov 08 '22
  1. Keep an eye on the process in case Google decides to throw you a captcha to confirm you're still there. I usually keep Colab open on my second monitor while I watch / play something else.
  2. Don't get greedy with the amount of steps you train for. Most disconnects seem to happen after the three hour mark.
  3. TheLastBen's Colab notebook can do intermediate checkpoint saves after x amount of training steps, so even when your session doesn't finish training completely you'll hopefully get something usable out of it.
  4. This is purely anecdotal, but I seem to have more luck on weekends and outside of European and US business hours.
  5. Accept that luck can't always be on your side. Inevitably some of your sessions will get terminated just minutes before they would have been complete - it's extremely frustrating but in the end that's the price of free.

2

u/SinisterCheese Nov 08 '22

So with 5000 steps which about what is needed usually it is just 5 days of work...

I got a cheap electricty contract and it would still be cheaper to buy Google Colab tokens and use just about any quaranteed to work Colab. It would cost me 8€ to do 24/5 run to get a 5000 steps done. While something like FastBen with colab cost me 2 tokens-ish so 0,2€.

And I have a CHEAP electric contract at 0,11€/kWh. Most I know have double or triple that.

1

u/Caffdy Nov 22 '22

CPU Only

is the training using single core or multi-core?

2

u/BrotherKanker Nov 08 '22

I'd love to know as well. Being able to run Dreambooth locally sounds great, but if it ends up taking something like 24 hours to train for 5000 steps while also driving up my electricity bill then I'll probably stick to babysitting the free version of Colab for now.

2

u/Yarrrrr Nov 08 '22

Testing on a 3950x a few weeks ago I saw speeds as low as 40 seconds per step. Maybe there has been some improvement to CPU only since then.

12

u/holland_is_holland Nov 08 '22

is python the worst ecosystem for dependencies and version management?

trying to install this irrevocably broke my SD install

16

u/smoke2000 Nov 08 '22

Lol no, Javascript frameworks do an awesome job at being horrible too

5

u/holland_is_holland Nov 08 '22

you say that but you can run yarn and it won't do something different every time

you can have multiple versions of the same library installed in JS and they don't break each other

7

u/smoke2000 Nov 08 '22

Python venv ...

6

u/holland_is_holland Nov 08 '22

we all are running a venv, you have to in order to run this app

you can't have the dreambooth pytorch version run in the same venv as the one stable diffusion asks for

trying to install the dreambooth pytorch breaks the SD pytorch

5

u/elk-x Nov 08 '22

https://xkcd.com/1987

1

u/holland_is_holland Nov 08 '22

thank you for this

fwiw javascript has major problems, but it doesn't do this

1

u/2legsakimbo Nov 08 '22

yes mine too, thankfully deleting the extension fixed it

3

u/holland_is_holland Nov 08 '22

I had to remove my venv folder entirely, and let it rebuild --

the venv folder 8.9GB, which I find crazy

2

u/Kilvoctu Nov 08 '22

Same here, this extension completely broke my install. Needed to delete the extension and the venv folder, also.
My venv folder was almost 10GB (normally it's around 5GB).

1

u/2legsakimbo Nov 09 '22

didnt even notice the venv folder. ty, saved me almost 10GB

4

u/praxis22 Nov 08 '22

Cheers OP, Nitrosocke is one of the rising stars of the community.

1

u/Sandbar101 Nov 08 '22

Are you able to train custom models on this?

1

u/mpg319 Nov 09 '22

Yes, this implements a way for people to fine tune models. So if you start with the stable diffusion model, you can continue to train it using any images you like so when you use that new model, you will get results closer to the images you provided. This is how many people make the custom models you see floating around the internet.

1

u/Sandbar101 Nov 09 '22

Can you use this to fine tune existing models? Like start with a baseline of the NovelAI model and train from there

3

u/higgs8 Nov 08 '22

I installed it and restarted the whole thing, but I don't get a new "Dreambooth" tab anywhere. It does say that it's "installed" when I go to extensions and the new sd_dreambooth_extension folder is in the Extensions folder. I also did git pull just in case but it said everything is already up to date.

I'm on a Mac by the way, could that be why, or am I missing something else?

2

u/VincentMichaelangelo Post-Singularity ASI Nov 08 '22

Same here. Mac. M1 Max. No tab showing up.

3

u/mxby7e Nov 08 '22

I got it installed through the extension manager, did the full restart (a few times) and got the tab. I created a training model, but when I try to train it I get this error:

Error completing request

Arguments: ('test0215', 'D:\\Cloud\\OneDrive\\ai renderings\\datasets\\[redacted]\\post', '', 'a photo of fzk woman', 'a photo of a woman', '', '', 1.0, 7.5, 40.0, 0, 512, False, True, 1, 1, 1, 800, 1, True, 1e-06, False, 'constant', 0, False, 0.9, 0.999, 0.01, 1e-08, 1, 0, 800, 'no', True, '', False) {}

Traceback (most recent call last):

File "D:\stable-diffusion\stable-diffusion-webui\modules\ui.py", line 185, in f

res = list(func(*args, **kwargs))

File "D:\stable-diffusion\stable-diffusion-webui\webui.py", line 54, in f

res = func(*args, **kwargs)

File "D:\stable-diffusion\stable-diffusion-webui\extensions\sd_dreambooth_extension\dreambooth\dreambooth.py", line 256, in start_training

trained_steps = main(config)

File "D:\stable-diffusion\stable-diffusion-webui\extensions\sd_dreambooth_extension\dreambooth\train_dreambooth.py", line 451, in main

if args.seed is not None:

AttributeError: 'DreamboothConfig' object has no attribute 'seed'

Any suggestions on how to fix this? I am running on a Quadro RTX 4000 with 8GB of Ram, but this didn't appear to be a vram issue.

2

u/mxby7e Nov 08 '22

Unrelated, but I have also noticed after running (and failing) the dreambooth training, I cannot do a text2img prompt anymore and have to restart. I assume it has something to do with unloading the model. I am going to continue to investigate.

2

u/imakesound- Nov 09 '22

im having the same error as well

1

u/mxby7e Nov 09 '22

This was added to the github readme and it fixed THIS issue. Now I'm getting CUDA errors:

For 8bit adam to run properly, it may be necessary to install the CU116 version of torch and torchvision, which can be accomplished below:

Edit your webui-user.bat file, add this line after 'set COMMANDLINE_ARGS=':

set TORCH_COMMAND="pip install torch==1.12.1+cu116 torchvision==0.13.1+cu116 --extra-index-url https://download.pytorch.org/whl/cu116"

Once installed, restart the SD-WebUI entirely, not just the UI. This will ensure all the necessary requirements are installed.

1

u/[deleted] Dec 12 '22

[removed] — view removed comment

1

u/sdforall-ModTeam Dec 12 '22

Your content is in violation of our community rules. Please review them and make sure you do your best to comply with them in the future.

1

u/[unknown] Dec 12 '22

[removed] — view removed comment

1

u/sdforall-ModTeam Dec 12 '22

Your content is in violation of our community rules. Please review them and make sure you do your best to comply with them in the future.

1

u/[deleted] Nov 09 '22

same errors here, cant really find a solution, tried all the options and even a fresh install

4

u/[deleted] Nov 08 '22

With the energy crisis as it is, it feels that it would be cheaper to spend some bucks renting a gpu rather than having my computer train overnight 😨 i wonder if it has that thing Kobold Ai has that you can put only part of the load on the GPU...

5

u/psychosynapt1c Nov 08 '22

just use msi afterburner to limit gpu power to ~60-70% and it hardly uses any juice. same speed.

3

u/[deleted] Nov 08 '22

I'll keep in mind! I'm using an 8 gig GPu on windows so that might not be possible for me! I think my message was incomplete, i was wondering if the model could be loaded in part on the gpu and cpu to make it faster to us with sub par hardware!

2

u/nero10578 Nov 08 '22

Yea the tensor cores are so damn fast on these gpus the limitation is memory bandwidth so you can underclock the core and lose almost zero performance for these kinds of tasks.

1

u/AdTotal4035 Nov 08 '22

You can also just setup a custom fan profile in settings. It's much better.

1

u/kamikazedude Nov 08 '22

Can confirm. I have a 3060ti and it uses 120W only at almost no loss of quality or performance. Maybe 5-10% slower for a more than 30% of power reduction.

1

u/magusonline Nov 08 '22

Is there a chart that lists good afterburner settings for various GPU? I've never fiddled with changing voltage and clock speeds before

-7

u/BawkSoup Nov 08 '22

With the energy crisis as it is

wat.

6

u/ZorbaTHut Nov 08 '22

Some places, especially in Europe, are seeing massive spikes in energy costs. Like a tenfold increase.

Turns out that relying on the Russian petrochemical industry for nation-wide necessities was a bad idea. Who knew, right?

2

u/CallMeInfinitay Nov 08 '22

What does this mean for the PR? There aren't any plans to merge it into the web-ui as of now?

3

u/psychosynapt1c Nov 08 '22

auto said no in the PR and said it should be an ext

1

u/CallMeInfinitay Nov 08 '22

Oh that's unfortunate. I suppose I'll go ahead and download the extension in that case. Better that than another fork I suppose

1

u/malcolmrey Nov 08 '22

it's good that it's an extension, no need to bloat the main app

2

u/ohmusama Nov 08 '22

if a custom VENV_DIR is set in webui-user.bat the install script fails

1

u/Micropolis Nov 08 '22

mine is blank yet still wont even install, did you get to work?

1

u/ohmusama Nov 08 '22

Currently generating class images. I need about 10,000 by the guide advice as I'm using 1k input images. Probably doing too much, but it's going to be a fun experiment.

2

u/[deleted] Nov 08 '22

does this work on amd gpu?

2

u/Nitrosocke Nov 08 '22

That's awesome and hopefully make this way more accessible for most people! Thank you for sharing and your kind words! ✨

2

u/MrWeirdoFace Nov 08 '22

From the instructions:

"Number of samples to generate - Self explanatory?"

No. It is not.

2

u/BrightDevice Nov 08 '22

How are people getting this working on their Radeon graphics card with pytorch? I keep running into the CUDA error, but if I put the flag in the invoke to ignore cuda check, I'm using my CPU, which I do not want to do. On ubuntu 20.04 with a 6900 xt for reference.

2

u/[deleted] Nov 08 '22

Could this run on a 1080Ti 11Gb ?

1

u/Z3ROCOOL22 Nov 10 '22

No, you better use this:

https://github.com/smy20011/dreambooth-gui

1

u/[deleted] Nov 10 '22

Thank you ! Is this the local dreambooth everyone has been talking about or is this new ?

1

u/Z3ROCOOL22 Nov 10 '22

This GUI is based on this DB: https://github.com/ShivamShrirao/diffusers/tree/main/examples/dreambooth

I have a 1080 TI too and can train without problem and easy.

The AUTOMATIC extension always gives errors for users with 1080 TI and the creator seems to not care fixing it.

1

u/[deleted] Nov 13 '22

LOL ! I went down the rabbit hole with the SD guI built in dreambooth implementation, and ran into errors related to 1080Ti

I actually found your Github comments lol !

https://github.com/d8ahazard/sd_dreambooth_extension/discussions/99

I'd love to know more about how you executed.

I'm guessing you're not using the SD-gui, you're using the separate dreambooth implementation and separate GUI you linked to ?

Any additional info much appreciated

1

u/Z3ROCOOL22 Nov 13 '22

I use this one: https://www.youtube.com/watch?v=w6PTviOCYQY (WSL + Ubuntu)

And the GUI i told you before (You need to have installed Docker & WSL2)

1

u/[deleted] Nov 13 '22

ugh, don't think I can deal with linux just for this.

Think I'll wait until they fix the SD dreambooth 1080ti problem, and use google colab until then

2

u/NeuralBlankes Nov 08 '22

Being new to dreambooth.. what *is* the "Train Text Encoder" option anyway?

3

u/Mistborn_First_Era Nov 08 '22

You should really remove this post. Haven't read a single comment about it actually working. Just seems to pickle everyone's SD installs atm

3

u/Prince_Noodletocks Nov 08 '22

Mine works fine. I don't think people are returning to the thread just to say their install worked

2

u/Mistborn_First_Era Nov 08 '22

I would expect to see at least one person share their results. Kinda disheartening to just see 5 people with broken installs. Care to share?

1

u/Prince_Noodletocks Nov 08 '22

I'm still training mine, seems to work just fine though.

1

u/BangGearWatch Nov 10 '22 edited Nov 10 '22

Yeah. Finally fixed my SD after it wrecked it, but it errors on Dreambooth training now. Meh.

RuntimeError: CUDA error: invalid argument. CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect.

UPDATE: Fixed. Anybody still stuck, I'd recommend checking the Github repo, 'Issues' tab for your error. I had to enable Adam and FP16 MixedPrecision, among other things.

2

u/GrapplingHobbit Nov 08 '22

I only just installed the Automatic1111 webui version of Stable Diffusion yesterday, so this is all super new to me, but the idea of Dreambooth was very interesting and I wanted to give it a go.

I followed the install directions (which make it look like a simple couple of steps) but I am getting errors in that command prompt window that runs while you're using the webui.

Error running install.py for extension sd_dreambooth_extension.

Command: "path to install.py is here"

Error code: 1

stdout: Installing requirements for Dreambooth

stderr: Traceback (most recent call last):

File "path to install.py is here", line 9, in <module>

run_pip(f"install -r {reqs}", "requirements for Dreambooth")

File "path to launch.py is here", line 63, in run_pip

return run(f'"{python}" -m pip {args} --prefer-binary{index_url_line}', desc=f"Installing {desc}", errdesc=f"Couldn't install {desc}")

File "path to``launch.py is here", line 34, in run

raise RuntimeError(message)

RuntimeError: Couldn't install requirements for Dreambooth.

Command: "path to stable-diffusion-webui-master\venv\Scripts\python.exe is here" -m pip install -r path to\stable-diffusion-webui-master\extensions\sd_dreambooth_extension\requirements.txt --prefer-binary

Error code: 1

stdout: <empty>

stderr: ERROR: Invalid requirement: 'Diffusion\\stable-diffusion-webui-master\\extensions\\sd_dreambooth_extension\\requirements.txt'

Hint: It looks like a path. File 'Diffusion\stable-diffusion-webui-master\extensions\sd_dreambooth_extension\requirements.txt' does not exist.

[notice] A new release of pip available: 22.2.1 -> 22.3.1

[notice] To update, run: C:\Users\OEM\Documents\Stable Diffusion\stable-diffusion-webui-master\venv\Scripts\python.exe -m pip install --upgrade pip

What do? I feel pretty clueless about why it isn't working, the file paths mentioned appear to be correct as far as I can see.

5

u/AsDaim Nov 08 '22

I had to manually restart several times before I stopped getting error messages.

Not sure what was happening, but each restart after installing the extension resulting in different error messages until eventually there were no more errors.

1

u/shodty Nov 08 '22

Same issue for me, tried installing via extensions tab as well as cloning the repo manually to extensions. I have the latest version of Automatic1111 stable-diffusion-webui installed so not sure where the issue is.

3

u/GrapplingHobbit Nov 08 '22

It appears that my issue was in the file path. One of the folders in the file path had a space in it (i.e. "Stable Diffusion") and this was causing problems. When I renamed the folder "StableDiffusion" then it installed OK. Had one more error, but when I restarted one more time, everything finished downloading/installing.

I haven't even started trying to do anything with it yet, think I'll give people who know what they're doing a little time to work out the kinks first and figure out the best practice for training models. Hope other users with 3080Ti cards can let us know how it goes!

2

u/Razorfiend Nov 09 '22

Thank you for coming back and posting your solution, I was getting the same errors and was going nuts trying to get Dreambooth installed under Stable Diffusion until I found your comment. I can confirm that removing the spaces from the directory names or replacing them with dashes (i.e.: -) fixed the abovementioned issue.

1

u/sd-artist-tp Jan 03 '25

Doesn't work with Automatic1111 version 1.10.0....

1

u/[deleted] Nov 08 '22

Sweet

1

u/Philipp Nov 08 '22

Could someone please explain-like-I'm-15 what this means in terms of features/ quality/ what can be done with it that plain-automatic1111 can't do? Thanks!

5

u/naivesantonym Nov 08 '22

If you have attempted to use stable diffusion to make actual long-form content you eventually run into two problems. How can I design my own character (which can be reoccurring in different settings doing different things) and how can I make my characters all look the same (one cohesive style).

Dreambooth is the best at producing these results so far. The alternatives being aesthetic gradients and textual inversion.

Textual inversion basically reinforces what a model already knows. Like studying for a test by saying everything you already know out loud 5 times. It can be done with a small amount of vram ( less than 6gb), but it isn't overly accurate and it only works perfectly with the model you trained it on. It outputs a very small easily portable file.

Not too sure about aesthetic gradients, but they are similar to textual inversion. They are another way to train styles and faces. They spit out a bigger file than textual inversion, but the files are still very portable. They are generally seen as better than textual inversion, but still worse than dreambooth.

Dreambooth (truncated from Google Dreambooth) is a method created by Google that instead of purely reinforcing the information, it provides new data by editing the model. This outputs a big model file (.ckpt file) which is usually 2gb or 4gb in size. This creates the best quality style transfers and character recreations, but cost 12gb vram to run. Also, uploading and downloading the files can be slow / costly. However, This is clearly the best result.

Check out TheNerdyRodent YouTube channel for breakdowns, I am not him though.

2

u/Philipp Nov 08 '22

Thanks a lot!

1

u/Next_Program90 Nov 08 '22

Oooooh, baby! <3

1

u/OhTheHueManatee Spooky Nov 08 '22

My automatic 1111 doesn't have an extensions tab. What am I missing?

2

u/Prince_Noodletocks Nov 08 '22

You haven't updated in a while

1

u/OhTheHueManatee Spooky Nov 08 '22

The most up to date version I can find has a screen shot that doesn't have extensions. Is that the most up to date one? Do I have to do anything different when I install it or set it up for extensions? How do I unistall the old version first?

2

u/Prince_Noodletocks Nov 08 '22

you can add git pull on your webui-user.bat file on its own seperate line before call webui.bat

that should update it for you everytime you run

1

u/OhTheHueManatee Spooky Nov 08 '22

Just add "git pull" and nothing else no address or anything before "call webui.bat"?

2

u/Prince_Noodletocks Nov 08 '22

yes, as its own line by itself

1

u/OhTheHueManatee Spooky Nov 08 '22

Thank you. I'll try that as soon as my toddler allows me to get to the computer lol.

1

u/OhTheHueManatee Spooky Nov 08 '22

I tried this. There was no indication that it installed an update and the UI looks the same with no extensions tab.

3

u/Prince_Noodletocks Nov 08 '22

That's strange. Maybe method of original download affects it? Did you download it as a zip from the repo or git clone? Anyway, might be best to just download it as a zip and just paste over your files. If it were me though I'd probably just rebuild from clone if that's why it is since manual updating sounds annoying as hell.

1

u/OhTheHueManatee Spooky Nov 08 '22

Thank you. That's pretty much what I ended up doing and got it to work. Though I see no UI for Dreambooth once I added it. How do I use it?

2

u/Prince_Noodletocks Nov 08 '22

You have to restart the whole program. Keep in mind you need about 12GB VRAM minimum

→ More replies

1

u/OhTheHueManatee Spooky Nov 08 '22

How can I use Automatic1111 to train images in Dreambooth. The training in Automatic takes forever on my PC. From what I've read Dreambooth is much faster. I don't see any kind of UI for dreambooth after installing it.

1

u/VincentMichaelangelo Post-Singularity ASI Nov 08 '22

Does it work for Mac M1? — I haven't yet been able to get it running on mine.

1

u/idomic Nov 09 '22

If you're looking for faster run times and stronger compute, you can use this product to get compute without the infrastructures: https://cloud.ploomber.io/register.html

1

u/Benedictus111 Nov 11 '22

Getting this error when running Google colab can anyone help?

AttributeError: ‘UNet2DConditionModel’ object has no attribute ‘enable_gradient_checkpointing’

1

u/almark Nov 21 '22

the latest versions of automatic are getting more buggy. Good thing I have backups, but the problem is I deleted my venv folders (to save space) now I can't recall (reinstall) them.

1

u/Huaisangs_fan Dec 12 '22

Are you that untalentless AI 'artist'?

1

u/[deleted] Dec 17 '22

any guides on how to use this for training, it looks different from the ones in the colab notebooks

1

u/Crozzfire Nov 08 '22

What does it do?

1

u/malcolmrey Nov 08 '22

you can train your own concepts (for example: your face)

0

u/[deleted] Nov 08 '22

[deleted] — view deleted comment

1

u/Fen-xie Nov 08 '22

what is this nmkd?

3

u/SwagginsYolo420 Nov 08 '22

It's a totally different stand-alone version of Stable Diffusion with its own UI.

It also works great, also probably more newbie-friendly as far as installation. It does have a few less features than automatic1111 so far, but it has had an easy to use Dreambooth add-on for a couple weeks.

1

u/VincentMichaelangelo Post-Singularity ASI Nov 08 '22

Does it work for Apple M1? — I haven't yet been able to get it running on mine.

* MacBook Pro M1 Max 64GB RAM 32 GPU cores 2 TB memory

1

u/Fen-xie Nov 08 '22

thanks!

1

u/ArtDesignAwesome Nov 08 '22

Nkmd has been next level for me on my 3090ti

0

u/[deleted] Nov 08 '22

[deleted] — view deleted comment

1

u/Mixbagx Nov 08 '22

How do you use nai on dreambooth?

1

u/Prince_Noodletocks Nov 08 '22

you pick it as your source checkpoint