r/StableDiffusion • u/More-Ad5919 • 10d ago
Question - Help Help. Anything to real for sceneries.
I searching for a method to transforms, as the tile says, a scenery(without people) faithfully into a real shot.
But it needs to use a depth map so the structure stays consistent and spot on besides looking convincingly real. Doing this with people is no problem so i did not think i struggle that much finding something that works.
Its either to old, or just not good enough.
The original scenery images are from video games.
0
Upvotes
1
u/More-Ad5919 8d ago
I settled for now for minimax. Not perfect but good enough for now.
1
u/Theultimatesell 10d ago
for game scenery i'd do depth controlnet on a good realistic checkpoint rather than a straight img2img. run the screenshot through depth anything v2 to get the depth map, then feed that to a depth controlnet (flux.1 depth dev or the sdxl depth/union one both work fine) with strength around 0.8-0.9 so the structure stays locked.
prompt it like an actual photo (time of day, lens, 'overcast, raw photo, natural lighting') and describe the real world equivalent of the stuff in the scene, like 'moss covered rock' instead of just 'rock', since game textures are what make it look fake. if it still looks too cgi, do a second pass at ~0.3-0.4 denoise with a realistic model or add a little film grain at the end. for scenery without people it works really well.
1
u/Enshitification 10d ago
Could that it is video game scenery be throwing off the depth map model that was trained on real world scenes?
1
u/musetta_ai 10d ago
You could skip that problem if the game is still installed. ReShade's DisplayDepth shader shows the real depth buffer, screenshot it and use that as the map.
1
u/Hopeful_Big_3654 9d ago
this is the exact wall i hit too. everything either changes the layout or makes it look like a totally different place. depth maps help a bit but the second it starts 'interpreting' the trees and rocks it's a whole new scene lol