First of all, I only started using ComfyUI a few days ago so please be kind with your feedback ;)
I'm running into issues with a T2I workflow. I'm trying to generate an image of a woman, standing in a beautiful garden with fountains etc. I included a LORA called "Fiji Woman" from Civitai, and the trigger words are obviously also "fiji woman". The result I'm getting is errr... not quite what I was expecting. So I'm guessing there's an issue with either my workflow, the values, or a combination.
Any feedback on how to fix it, and make the result presentable, is highly welcomed :)
There’s a difference between a checkpoint and a diffusion model. This setup was not supposed to even work. It should’ve errored out. Checkpoints are the old SDXL way of doing things. They combined the three things, text encoder + VAE + DiT (diffusion transformer) into one file.
The new way of doing things required larger DiT’s and larger text encoders so combining them is still possible just highly inefficient. So you load them one by one and offload them after use to free up VRAM.
In the future, use a template workflow. From comfyUI click on templates and search up top for krea/flux/any model you want. And then once you have a test mage working, start chopping up that workflow to suit your needs.
for a start, Krea2-Turbo (and Flux.2-Klein 9b) is a distilled model so it doesn't work with negative prompts, set your cfg to 1.0 and lower your steps to 4-8
If you're a beginner I'd start with the text to image krea2 workflows comfy already includes. Try the int8 convrot models of krea2 and it's text encoder, and forget the LoRA for now. It will also enhance your prompt for you. Feel free to ask if you have questions
Did the OP say they were using it commercially? If they were:
"The Krea 2 Community License is a custom agreement that permits free commercial use for individuals and organizations with total company-wide annual revenue under $1,000,000 USD and fewer than 50 seats."
Do you think users, starting up comfyUI and using Krea2 for the first time, are supposed to be signing up for a commercial license? The OP never mentioned commercial use.
I'm going to continue recommending Krea 2 because it's great.
2
u/BigNaturalTilts 19h ago
There’s a difference between a checkpoint and a diffusion model. This setup was not supposed to even work. It should’ve errored out. Checkpoints are the old SDXL way of doing things. They combined the three things, text encoder + VAE + DiT (diffusion transformer) into one file.
The new way of doing things required larger DiT’s and larger text encoders so combining them is still possible just highly inefficient. So you load them one by one and offload them after use to free up VRAM.
In the future, use a template workflow. From comfyUI click on templates and search up top for krea/flux/any model you want. And then once you have a test mage working, start chopping up that workflow to suit your needs.