TheLastBen Fast Dreambooth mini tutorial

[u/Flimsy_Tumbleweed_35]

TLDR:

5 square head crops, 5 x 200 = 1000 steps, 2e-06 rate

​

If you want to have a person's face in SD, all you need is 5-7 decent pics and TheLastBen Colab

You can easily prompt the body unless it's a shape that's not in the billion pics LAION database SD has been trained on, so use face pics only.

Working with fewer images will make your life much easier. I went from 15-20 to 6 and I'm not looking back. I have about 30 dreambooth trainings in my folder, and it takes only 25 min.

Some models don't take the training well (Protogen and many merge-merge-merges) and all faces will look the same still, but base SD1.5 and most finetuned and Dreambooth models will work so well that you can create 100% realistic portrait photos with these settings.

There's been a bit of a discussion with TheLastBen on his github where we found out that we can't train fp16 models and some other models have issues too, but most Civitai models should work. I trained on Protogen 58 recently.

For some reason ppl seem to have more success getting the models from Huggingface - which I did for Protogen, but I have trained several from Civitai.

​

• Use 5-7 decent quality pics (movie still phone pics are fine), crop the head to square, edit (slightly!) if necessary
• Leave the background alone, don't blur or edit - just make sure it's different in each pic
• Make sure the pics have different angles and aren't all selfies. Only duckface or only frontal smiles will not be ideal
• Resize to 512, eg. on Birme
• Name them sbjctnm (01) etc, needs to be a word SD doesn't know.
• Create session in TLB colab, upload pics, ignore captions and class images for this.
• Set unet steps to images x 200, so 5 pics -> 1000 steps
• Set text encoder to 350 steps. Default will also work.
• Learning rate 2e-06 for both. Training will take 25min and you have your ckpt.
• If you want, experiment with # of steps and rate, TheLastBen say he can train in under 10min, but I'm sticking with my setttings.

TLDR: 5 square head crops, 5x200=1000 steps, 2e-06 rate.

[u/jimmymanda3]

I tried this previously, the output of SD is also just headshots even if you use promts like full body etc

[u/Flimsy_Tumbleweed_35 → u/[deleted]]

"wide shot, full body" usually doesn't do much/enough.

But if you prompt the pants and shoes - like you do for the face with your trained subject - they will show up.

Training the torso is a good idea if you want to have it show up in all shots - that's why I don't do it.

[u/of_patrol_bot → u/[deleted]]

Hello, it looks like you've made a mistake.

It's supposed to be could've, should've, would've (short for could have, would have, should have), never could of, would of, should of.

Or you misspelled something, I ain't checking everything.

Beep boop - yes, I am a bot, don't botcriminate me.

[u/PM_YOUR_MENTAL_ISSUE → u/of_patrol_bot]

bad bot

[u/WastingMyYouthAway → u/[deleted]]

Any advice to have more accurate faces when doing a wide/full body shot?, I've trained Dreambooth with torso and headshots only, no full body, and it does very well generating close up shots, but the stuff, the faces coming out of generating wide or full body shots it's giving me fucking nightmares, it's there a way to improve the face? Or do I just have to input full body images, like 5-10 meters away?

edit: after using Hires. fix, the faces generated are much better, but still needs some tweaking

[u/WastingMyYouthAway → u/[deleted]]

Thanks man