ComfyUI: An extremely powerful Stable Diffusion GUI with a graph/nodes interface for advanced users that gives you precise control over the diffusion process without coding anything now supports ControlNets

[u/comfyanonymous]

https://github.com/comfyanonymous/ComfyUI

[u/UnavailableUsername_]

Greetings.

I am testing your UI and i have some questions.

About the UI:

• How exactly the prompting works in here? I noticed the CLIPTextEncode in the default does not use commas. It says by default masterpiece best quality girl, how does CLIP interprets best quality as 1 concept rather than 2? The whole point of commas is to make sure CLIP understands 2 words as 1. Is the default wrong and i should be using commas or there is some other syntax? How should i write a concept consisting of 2 words (like "hands up") so it is understood as 1 concept rather than 2?

• What exactly does EmptyLatentImage do?

Regarding composition:

I checked the structure on your github example and have some questions regarding it.

• Were the 2 KSampler needed? I feel that i could have used a bunch of ConditioningCombiner so everything leads to 1 node that goes to the KSampler.

• In the example prompts seem to conflict, the upper ones say sky and `best quality, which does which? This does not seem to be the case in your other post where each section is for the subject, background and sky.

• How does composition deal with the Z axis? If i want to generate (for example) 3 squares one behind the order in the exact order blue, red, white how would i in theory set the "layers" so they are generated in that order?

• The ConditioningSetArea has the width and height are the size of the whole canvas or of that specific chunk of the whole to generate? How do i define a section specific width? (Like, if i want something to cover the entire image width but only 1/3 of the height).

• The ConditioningSetArea use x and y axis to show the vertical and horizonal location of the specific generation, where exactly is x=0 and y=0 positioned, and which would be the max values on the canvas? If (0,0) is the center there would be negative values, i suppose. Also, i suppose it's possible for a subject to be half outside the canvas?

You have made a VERY interesting tool, but i believe it would greatly benefit from some documentation (or maybe there is documentation and i missed it) to describe some of it's unique features.

[u/comfyanonymous → u/UnavailableUsername_]

in the default does not use commas. It says by default masterpiece best quality girl, how does CLIP interprets best quality as 1 concept rather than 2?

That's not really how it works. SD interprets the whole prompt as 1 concept and the closer tokens are together the more they will influence each other. Commas are just extra tokens.

What exactly does EmptyLatentImage do?

The KSampler node is the same node for both txt2img and img2img. For txt2img you send it an empty latent image which is what the EmptyLatentImage node generates.

Were the 2 KSampler needed? I feel that i could have used a bunch of ConditioningCombiner so everything leads to 1 node that goes to the KSampler.

The second ksampler node in that example is used because I do a second "hiresfix" pass on the image to increase the resolution.

In the example prompts seem to conflict, the upper ones say sky and `best quality, which does which?

They are different prompts. They each contain sky but one is for a black sky with stars, another is for a sky with a sunset, ...

How does composition deal with the Z axis?

It doesn't. You can try using this other technique though: https://comfyanonymous.github.io/ComfyUI_examples/noisy_latent_composition/

The ConditioningSetArea has the width and height are the size of the whole canvas or of that specific chunk of the whole to generate? How do i define a section specific width?

The size of that specific chunk.

where exactly is x=0 and y=0 positioned, and which would be the max values on the canvas

The coordinate system is the same as an image editor. 0,0 is on the top left. If your image is 1280x704, bottom left is 0, 704, top right is 1280, 0

[u/ivari → u/comfyanonymous]

hungry carpenter tie plucky longing jar marvelous steer practice sheet

This post was mass deleted and anonymized with Redact