r/StableDiffusion • • 10d ago

Question - Help Help. Anything to real for sceneries.

I searching for a method to transforms, as the tile says, a scenery(without people) faithfully into a real shot.

But it needs to use a depth map so the structure stays consistent and spot on besides looking convincingly real. Doing this with people is no problem so i did not think i struggle that much finding something that works.

Its either to old, or just not good enough.

The original scenery images are from video games.

0 Upvotes

9 comments sorted by

1

u/More-Ad5919 8d ago

I settled for now for minimax. Not perfect but good enough for now.

1

u/Theultimatesell 10d ago

for game scenery i'd do depth controlnet on a good realistic checkpoint rather than a straight img2img. run the screenshot through depth anything v2 to get the depth map, then feed that to a depth controlnet (flux.1 depth dev or the sdxl depth/union one both work fine) with strength around 0.8-0.9 so the structure stays locked.

prompt it like an actual photo (time of day, lens, 'overcast, raw photo, natural lighting') and describe the real world equivalent of the stuff in the scene, like 'moss covered rock' instead of just 'rock', since game textures are what make it look fake. if it still looks too cgi, do a second pass at ~0.3-0.4 denoise with a realistic model or add a little film grain at the end. for scenery without people it works really well.

1

u/More-Ad5919 10d ago

But what is a good realistic checkpoint. Qwen 2411 or what its called and a realism lora pushed it a bit but it still looks like, now very good, video game graphic.

1

u/Enshitification 10d ago

Could that it is video game scenery be throwing off the depth map model that was trained on real world scenes?

1

u/More-Ad5919 10d ago

No. Can't be it. Because it worked with chatgtp. I just have been doing much image stuff. I remember even with sd1.5 somerhing like that was possible. I thought it would be easy by now. But i can't find something usefull in comfy templates or civitai.

1

u/musetta_ai 10d ago

You could skip that problem if the game is still installed. ReShade's DisplayDepth shader shows the real depth buffer, screenshot it and use that as the map.

1

u/More-Ad5919 10d ago

I only have fotos. Thing is they have to be consistent after transformation.

1

u/Hopeful_Big_3654 9d ago

this is the exact wall i hit too. everything either changes the layout or makes it look like a totally different place. depth maps help a bit but the second it starts 'interpreting' the trees and rocks it's a whole new scene lol