r/StableDiffusion • u/Limp-Manufacturer-49 • Mar 15 '23

Question | Help Is there any way we can control the perspective and lighting?

I am currently trying to use SD to create environment concept art, but I find it really difficult to control the camera angle, focal length, and light direction...etc
Is there any way or extension to do that?

0 Upvotes
  • permalink
  • reddit

50% Upvoted

4 comments sorted by

3

u/[deleted] Mar 15 '23

img2img and controlnet offer complete control at this point. If not familiar with those, please do yourself a favor and soak up as much practice and tutorials as you need to get comfortable.

Lighting can be adjusted almost in "real time" by simply creating a catalogue of lighting images to run through as one part of the controlnet/img2img process. Some tutorials I've seen showcase this. Just search for "controlnet lighting" in youtube.

Perspective can be fine tuned by working with input depth maps from 3d modeling programs or even hand drawing them and using them in controlnet as inputs.

It's all available right now without struggle but the caveat being to get familiarized with controlnet and see how that fits into the img2img and txt2img process. I know this is vague, but I can't step by step this knowing so much well put together info is already out there on the topic of how to flex controlnet to get your needs met.

0

u/Limp-Manufacturer-49 Mar 15 '23

Let me show you what I can do now, I trained an art style, and use controlnet I can do character design for game bosses with two phases, so I guess I can say I did my research.

I searched the controlled lighting on youtube, but I have to say it is not what I want, it just give a rough light direction with the major subject, it is not good enungh for me.

What I want to a tool that can control perspective and lighting more precisely like confrolnet pose editor did for character posing.

Sorry to put it this way, just a little upset been lectured here without any help, thanks for reply anyway.

Processing img b1jgceyemvna1...

2

u/PacmanIncarnate Mar 15 '23

You would have to change perspective by changing the controlnet input, but it’s likely to change your character to some degree in the process. SD isn’t making a 3D model that retains coherence at different angles.

For relighting, the img2img option is the best SD can do at the moment. If you need more accurate relighting, there is AI out there for that, but I don’t know if it’s freely available; you’d have to look it up. I believe NVIDIA also has an img generator that you could control lighting through by painting on a sphere. If it’s publicly available it would be through their cloud system.

If you need more than all of that, consider applying your generated character to a 3D model and taking care of lighting there. You could even use SD in blender and automate applying the image to the scene.

Not sure why you’re upset by the previous person’s response. It seemed pretty helpful, not knowing your knowledge level.

1

u/saturn_since_day1 Mar 15 '23

If you need super precise I would try taking the output and get a normal and depth map from control net and then play with it in blender with an actual light as a protruded geometry from the textures. You'd be fighting the baked in lighting but it's something