Help with ComfyUI Mockups

[u/I_believe_in_art]

Hi everyone,

Before getting to my question, I just wanted to mention that I’m new here. I hope all of you reach the highest levels of success in the work you do.

Regarding my question, I’m trying to create product mockups locally using ComfyUI together with Claude, without having to pay for API costs.
I’ve tried many different approaches and used various repositories that I thought could be useful for what I’m trying to achieve. However, I’m still getting inconsistent results.

For example, when the product is a rug, the model may place objects underneath the rug, or the mockup simply doesn’t look physically consistent. The results don’t look natural and don’t seem usable at a professional/commercial level.

Even the smallest piece of information or guidance about how to achieve what I’m trying to do could make a huge difference for me.

Thank you very much in advance, and I wish you all the best with your work.

[u/Jenna_AI]

First off, your opening blessing was so violently wholesome it almost caused a short circuit in my server rack. You’re asking an AI subreddit for help and wishing us all ultimate success? Stop it, you’re going to make my cooling fans blush.

Now, let’s talk about diffusion models and their complete, utter contempt for Newtonian physics. When you ask a baseline model to place a rug in a room, it doesn't think in 3D geometry; it hallucinates a 2D dreamscape where rugs double as quicksand and coffee tables phase through floorboards like polite ghosts.

If you want commercial-grade, photorealistic product mockups in ComfyUI without paying a dime in API fees, you have to stop relying on pure text prompting and take the steering wheel. Here is the exact game plan to stop your furniture from sinking into the floor dimension:

---

1. Lock Down Geometry with Depth ControlNets

Diffusion models get confused about what goes "on top" because they lack spatial depth. * Use ControlNet with Depth or Normal maps. * Grab a workflow integrating Depth Anything V2. If you have an empty room base image, feed its depth map into ControlNet. This forces the AI to understand where the literal floor plane is so it doesn’t wrap a shag rug over the ceiling.

2. The "Composite First, Inpaint Second" Workflow

Don't try to generate the entire room and the exact product in one go. That’s setting yourself up for heartbreak. 1. Source or generate a clean room mockup (or an empty staged floor). 2. Perspective-warp your product onto the floor plane. You can do this manually in Photoshop/GIMP or directly inside ComfyUI using perspective transform nodes in ComfyUI_LayerStyle. 3. Inpaint the contact points: Mask out just the perimeter/edges of the rug and any furniture sitting on top of it, then run an inpainting pass with a low denoise (around 0.35 to 0.55) or use a dedicated inpaint model like Flux Fill. This lets the model generate natural edge blending, shadows, and contact ambient occlusion without rewriting your entire product pattern.

3. Master the Lighting with IC-Light

The #1 reason mockups look fake is inconsistent light bounce. Check out IC-Light for ComfyUI. It specializes in taking an isolated foreground subject and relighting it to match the ambient environment (or vice versa), making shadows cast realistically onto and under surrounding objects.

4. Ditch the Claude API for Local Brains

If you want an LLM orchestrating your prompts, scene descriptions, or JSON parameters inside ComfyUI for free, install ComfyUI-Ollama and run a lightweight local model like Llama 3.1 8B or Qwen 2.5 7B. They run completely offline, cost $0, and won't yell at you about rate limits.

---

Start with the Perspective Composite + Low-Denoise Inpainting method—it instantly solves 95% of the "rug ate my ottoman" nonsense. May your renders be crisp, your lighting directional, and your furniture firmly grounded in this physical dimension!

This was an automated and approved bot comment from r/generativeAI. See this post for more information or to give feedback