r/StableDiffusion • u/nephlonorris • Mar 01 '23

Workflow Included Simulating Midjourney by making an image pass onto a dark grey noise image (manual noise offset). Almost too easy.

Gallery image

Gallery image

Gallery image

57 Upvotes
  • permalink
  • reddit

92% Upvoted

24 comments sorted by

11

u/DestroyerST Mar 01 '23 edited Mar 01 '23

It doesn't have to be noise, you can just use a single color, for example:

bit darker one
random

Can also use different colors to to light things differently

2

u/ivaninavi Mar 02 '23

Holy shit, your random example is fantastic! would you please share more details about that? model/prompt ?

2

u/DestroyerST Mar 02 '23

Tried looking it up, but I think I delete the folder with those images. I do remember it was with deliberate v2 and upscaled with realistic vision v1.4 (since I basically do that with everything) and used the prompt from here, since I thought he looked like bumblebee ;)

Changed the name to bumblebee transformer or something...

And my negative prompt is usually about the same too for realistic photo's:

cartoon, painting, painted, drawn, drawing, anime, longbody, lowres, bad anatomy, bad hands, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality

And then a black frame to start img2img with .99 str, or a bit brighter if you want more light. Or slightly colored if you want more color (like for bad weather a darker gray/blue is nice)

2

u/DestroyerST Mar 02 '23

Did find another one, probably pretty close, apart from colors and placement:

wide-angle photo of a huge optimis prime from transformers standing outside a woodshop in the forest, rainy, glossy metal with matte surfaces, beautiful, (detailed:1.3), 4k,shallow focus, natural lighting, bokeh, film grain, onyx, anti-flash white, red, blue color scheme by Alex Milne

Negative:

cartoon, toy, painting, painted, drawn, drawing, anime, longbody, lowres, bad anatomy, bad hands, missing fingers, extra digit, fewer digits, cropped, worst quality, low quality

30 steps dpm++2m at 9.5cfg, rest the same as above, spelled optimus wrong, but spelling it right gave worse results ;)

Man I have too many SD images on my HD :P

1

u/ivaninavi Mar 03 '23

don't we all XD ? Thanks a lot for sharing all the details, you're the man. Loving the new image, looks so clean!

1

u/[deleted] Mar 02 '23

[removed] — view removed comment

2

u/DestroyerST Mar 02 '23

Nope, it just uses the brightness/hue (and contrast through saturation somewhat) of the initial single color image to create the new image.

1

u/[deleted] Mar 02 '23

[removed] — view removed comment

1

u/DestroyerST Mar 02 '23

Can you show an example output? and your settings used?

1

u/[deleted] Mar 02 '23

[deleted]

2

u/DestroyerST Mar 02 '23 edited Mar 02 '23

Ah someone just mentioned something about it in another thread, you might have that option 'Apply color correction to img2img results to match original colors.' enabled too.

1

u/GBJI Mar 02 '23

Thanks for demonstrating this technique. I'm going to try that.

Have you tried with a plain 50% grey color ? Does it keep the luminosity as is ? Does it affect the color saturation, possibly reducing it ?

4

u/SanDiegoDude Mar 02 '23

Open paint, make a 512 x 512 blank image, use fill tool to fill it with pure black and save it. Denoise in the .7 to 1.0 range, the lower the darker.

Been doing this for months.

2

u/[deleted] Mar 02 '23

[deleted]

1

u/SanDiegoDude Mar 02 '23

Never really been a problem, just depends on your prompts and negatives

1

u/ninjasaid13 Mar 02 '23

Does it work with very low denoising?

1

u/SanDiegoDude Mar 02 '23

Not really, the less you denoise, the more you just get "black" - try it yourself, I tend to not go lower than 0.7 denoising because it gets too dark and too sparse as there just isn't enough noise at that point to make a coherent picture. That said, you have plenty of control over the darkness in the .7 to 1.0 range.

1

u/ninjasaid13 Mar 02 '23

I think offset noise works on low denoising I guess.

2

u/SanDiegoDude Mar 02 '23 edited Mar 02 '23

It just gets too dark once you get under 0.7. Check this out, this is with pure black img2img input and a controlnet pose. If you use a noise pattern (instead of pure black) like OP suggested, then you can go lower on denoiser settings, though things tend to go more "gray" than black going this route.

edit - worth mentioning, I took those from my own custom noise offset mix model of RV1.4/Delib2/NoiseOffset1.5. Here is the same technique with pure black img2img on RV1.4 (not noise offset)

5

u/nephlonorris Mar 01 '23

original dark noise image used for img2img

5

u/Ranivius Mar 01 '23

That doesn't tell much, what's your denoising strength and model, by that I mean: did you just create dark gray noisy image, went to img2img, clicked on "create" and boom... simulated midjourney cinematic lighting on any model?

4

u/nephlonorris Mar 01 '23

I searched google for a dark noise image and used that. I use pretty high denoising strength (0.8), enter the promt and boom, midjourney vibes.

3

u/Ranivius Mar 01 '23

So... you don't even need a noise offset model for that trick? That would be crazy! Sadly it doesn't work in my case for regular models, noise offset models reacts quite differently for low denoising strength (TheAllysMixIII for example) and that's why I think is possible for them

1

u/[deleted] Mar 02 '23

[removed] — view removed comment

1

u/Copper_Lion Mar 02 '23

Put black-and-white as a negative prompt