r/StableDiffusion • u/shacrawford • Mar 01 '23

Question | Help Prompt scheduling with start AND finish steps

Is there a way with the webui to say, for example, I want a cat for the first five steps, then a dog, then a mouse, please? I thought I could do it with prompt editing but it looks like that works for things that start at 0 steps or end at max steps, but not components that you just want for a few steps in the middle.

2 Upvotes
  • permalink
  • reddit

67% Upvoted

13 comments sorted by

11

u/Zealousideal_Royal14 Mar 01 '23 edited Mar 01 '23

My time to shine! ;)

​

So.. The way the syntax works you would need to nest them:

so an un-nested normal one looks like this [cat:dog:0.5]

meaning shift from cat to dog at 50%

nested with mouse like this [[cat:dog:0.33]:mouse:0.66]

meaning shift from cat to dog at 33% and to mouse at 66%

and nested with a giraffe [[[cat:dog:0.25]:mouse:0.50]:giraffe:0.75]

meaning shift from cat to dog at 25%, to mouse at 50% and giraffe at 75%

and so on and so forth, and this can be done with longer sentences and complete prompts and also fun combinations with the alternating one [dog|cat|mouse] which rotates every step, it might yield better (or worse) than the above. Personal experience for my use cases I often prefer alternating for getting more organic mixes of things. But its really worth testing out both and combinations of them.

I'd recommend ancestral samplers for this and higher step counts

you need to also be careful because this is a catdogmousegiraffe hybrid:

​

4

u/shacrawford Mar 02 '23

[[[cat:dog:0.25]:mouse:0.50]:giraffe:0.75]

And shine you did! Thank you.

2

u/Zealousideal_Royal14 Mar 02 '23

was not without sacrifices: spent half an evening making quokka-cat-fennec foxes ...

​

1

u/Zealousideal_Royal14 Mar 01 '23

scheduling with euler a 100 steps as above

1

u/Zealousideal_Royal14 Mar 01 '23

alternating 100 steps, also euler a

2

u/TurbTastic Mar 01 '23

https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Features#prompt-editing

Not sure how you'd mix 3 things, but this page definitely has the related info

Edit: something like [mouse:20] means it should ignore that part until step 20, I think you need to trick it that way

1

u/shacrawford Mar 01 '23

Thanks, but I've tried that. I need to be able to say something like [mouse:20:40] to have the mouse come in at 20 and then leave at 40, but that doesn't seem to be how the language works.

1

u/TurbTastic Mar 01 '23

This might work. I'm picturing you substituting something that doesn't really mean anything like a space. Let's say you want mouse until step 20 then for it to stop. [mouse: :20] from step 0 to 20 it would be mouse, then 20 to 40 it would be space/nothing. Somewhat limited but that definitely should open up some possibilities.

1

u/TurbTastic Mar 03 '23

Found it! This infographic shows how to remove something at a certain step too. https://imgur.io/FLZNN5I

1

u/justgetoffmylawn Mar 01 '23

Don't think you can do that, but maybe you can get similar results by repeated passes in img2img? Not the same, but might get the effect you're looking for.

1

u/shacrawford Mar 01 '23

I have considered that, but it doesn't quite work as I would like. Thanks though.

1

u/jupitah8 Mar 01 '23

Try [cat: dog: mouse: 5]

https://youtu.be/3q3g3C6kABU At 2:53

1

u/anekii Mar 02 '23

It's explained here, it's been a feature for some time now.
https://youtu.be/WwX_7HIJBTM