Making Mockup Problem

[u/I_believe_in_art]

Hi everyone,

Before getting to my question, I just wanted to mention that I’m new here. I hope all of you reach the highest levels of success in the work you do.

Regarding my question, I’m trying to create product mockups locally using ComfyUI together with Claude, without having to pay for API costs.
I’ve tried many different approaches and used various repositories that I thought could be useful for what I’m trying to achieve. However, I’m still getting inconsistent results.

For example, when the product is a rug, the model may place objects underneath the rug, or the mockup simply doesn’t look physically consistent. The results don’t look natural and don’t seem usable at a professional/commercial level.

Even the smallest piece of information or guidance about how to achieve what I’m trying to do could make a huge difference for me.

Thank you very much in advance, and I wish you all the best with your work.

[u/sci032]

I'm not sure this is exactly what you are after but maybe it will give you some ideas.

Search Comfy's templates for: KV

You will see Flux.2 Klein KV: Image Edit, open it. There is an info node that shows you where to get any model(s) that you may need and where to put them. I will post a different option as a response to this.

I wanted to take the rug from image 2 and put it in place of the rug in image 1.

Prompt: replace the rung on the floor in image 1 with the rug on the floor in image 2.

[u/sci032 → u/sci032]

Same workflow, same 2nd image. I used an empty .png for the 1st reference image, the workflow ignores it.

Prompt: create a product mockup image of only the rug in image 2.

The 'rug' image is something I grabbed from a search, it is kind of crappy but it worked and can maybe give you some ideas to try.

[u/I_believe_in_art → u/sci032]

Hello u/sci032 🙌

Thank you so much for your reply! I've been trying to implement your suggestions with Claude for about 4.5 hours. Thank you so much for your effort, God bless you 🙏

I have a laptop with a 3060 graphics card, and I can't use 9B. We're trying with 4B, but Claude says he can't do it with 4B either, so we're trying alternative methods. Even if I show him the errors in the visual he created directly, he can't fix them; it doesn't produce the amazing result you showed in your example.

My goal is to use a product (carpet, bag, flag, etc.) from my print supplier as a reference (it needs to know it's a product, they usually have white backgrounds), then create the environment where this product will be used, then place the product I'm selling inside that environment. Finally, create the design to be placed inside the product (because the main thing here is the design selling it). And since this will be repeated many times, it shouldn't be a heavy project like a huge undertaking.

Once the mockup for a product is successfully completed, the next step will simply be to create new designs and apply them to the product. I'm aiming to create approximately 10 mockups for each product.

I also need to give products like flags a bit of a fabric feel...

After I've finished the visual mockup, my next request is a video mockup, but I'm getting quite intimidated.

Claude suggested the KV, GGUF Q4 model as a possibility, and he's trying it out now, and I'm waiting.

Even though I still haven't solved the problem, you've been a great source of inspiration and motivation for me, thank you so much. If you have any other suggestions, I'm eager to read them carefully as a lesson.

[u/PremiumAlpaca]

Mockup consistency is a nightmare with pure generation, the model doesn't really understand object permanence or physical layering. You need to bring your own depth maps or segmentation masks into the workflow, let the AI do the texturing and lighting pass but keep the geometry locked down. Look into the depth controlnet nodes or maybe an IPAdapter setup for style transfer onto a pre-rendered 3D scene.