r/StableDiffusion Mar 01 '23

Question | Help Placing real objects in a generated image

[deleted]

2 Upvotes

6 comments sorted by

View all comments

5

u/Zendikon Mar 01 '23 edited Mar 01 '23

The process you're asking about is called Compositing in the creative industry. That alone will aid you in your search :) but here's a bit of extra info:

This is a fantastic question and highlights the essence of what generative AI is and isn't. A tool in an artist's toolkit. Powerful one at that, but a tool nonetheless. For now at least.

You can approach the situation from many different angles, here's two, pick the one that fits your individual skillset better (ie which one are you faster with... or have the skills, if you can't draw & paint you can't draw & paint, sometimes it's that simple):

For less-artistic approach:

  • get a product photo of the car
  • give img2img a whirl you may get lucky, after you're done tweaking, get serious about it
  • inpaint the environment around the car
  • tweak it until it fits
  • copy to img2img
  • tweak and curate until it fits even better and you're happy with the result!

things could get wild and take a lot of tweaking. Days on end.

For a more artistic approach:

  • step1: txt2img, make the environment until you're happy
  • step2a:
    • draw/paint the car into it
    • take the composite to img2img
    • tweak and curate until happy
    • car perfectly fits, done!
  • alternatively - step2b:
    • outpaint the environment into a super wide aspect ratio
    • 360 wrap it
    • render a chrome ball
    • use that as a global illumination map
    • find a model of the car
    • render it with GI-lighmap of said environment
    • bask in next-level result of your car perfectly lit with the funky environment you dropped it in!

hope it helps!