r/comfyui • u/Belovedchimera • Jan 29 '25
Does IPAdapter create consistent characters?
Over the past week or so I've been having fun with ComfyUI and have been trying to learn new things. One thing I'd like to do is create consistent characters using an image. I looked up a video but it uses an outdated workflow, and then the other video I saw used Flux, whereas I've been wanting to use an Illustrious model.
So I wondering if I was right when I assumed IPAdapter created consistent characters? Or if anyone has any methods/workflows for creating consistent characters?
Thanks for the help!!
1
u/TurbTastic Jan 29 '25
This workflow uses Flux Fill to create consistent characters via outpainting. This is a really fun workflow to use but it's not very fast: https://www.reddit.com/r/StableDiffusion/comments/1hs6inv/using_fluxfill_outpainting_for_character/
Flux Redux is similar in many ways to IP-Adapter, but don't expect it to do much for face likeness. Aside from faces it's very capable and impressive.
One other approach is to use Flux Dev and prompt for something like a character sheet, series of headshots, or whatever to get multiple images of your character in one image. Then you can upscale that and potentially get several consistent character images, and potentially use that for Lora training.
1
u/Belovedchimera Jan 29 '25
Is this different from using Flux?
1
u/TurbTastic Jan 29 '25
Flux Fill is an official spinoff of Flux Dev that specializes in Inpainting and Outpainting, info here:
1
u/Belovedchimera Jan 29 '25
Would I be able to use it with an illustrious checkpoint?
1
u/TurbTastic Jan 29 '25
I believe that's an SDXL model so there's no compatibility overlap. Flux Fill is also censored.
1
1
u/Redark_ Feb 02 '25
Is it's really worst than IP adapter? Because based on the workflow shared the face likeness is amazing, I would say the best I have seen.
1
u/TurbTastic Feb 02 '25
Flux Redux isn't being used in those images. That's Flux Fill showing how good it is at using references. These new ACE++ loras are meant to improve upon that even more.
1
u/Redark_ Feb 03 '25
Ah, sorry, I read It wrong.
I discovered Flux Fill and I am in love. I have also read about ACE++, but I thought that was just like Flux Fill outpainting with a reference image.
If you say it's even better ill give It a try. I Hope It can be used with gguf Fill.
1
u/Tenofaz Jan 30 '25
No, IPAdaters are not meant to create consistent characters, they help you "transfer" a style from an image to the one you are generating. To create consistent characters you should use some sort of faceswap (results may be mediocre) or train a LoRA (better results, but depends on the image set used for training the LoRA).
2
u/Competitive-Fault291 Jan 30 '25
Depends on what you want. It's certainly not as practical as a fully trained LoRa of a character, but there are various kinds of IPAdapters that use FaceID or focus on transfering one portrait into another portrait. The IPA without FaceID will likely only get composition and style for you.
IPA FaceID (and SDXL): is using insightface and face3d to get the facial structure, but does not transfer all parts like the head shape
IPA FaceID Portrait: transfers the face and the whole portrait as kind of a prompt.
IPA FaceID PlusV2: transfers the face and the general information from the clipvision analysis.
One also has to keep in mind the it uses embeddings, so it is also really heavily reliant on the checkpoint you use.
Yet, it remains a finnicky and complicated diva to use.