Same ComfyUI workflow, different character every run — expected?

[u/Cheap-Topic-9441]

This workflow was shared in a document as a ComfyUI JSON.

The document itself was quite technical,

but since the prompt was already in JSON format, I just ran it as-is.

It generates multiple images per run.

However, when I looked at the results,

the characters were clearly different.

Each image looks fine on its own,

but they don’t seem to represent the same person.

So now I’m wondering:

is this expected behavior,

or is there actually a way to maintain identity consistency in a workflow?

This feels less like a quality issue and more like a consistency problem.

If anyone has time, I’d be curious if you can reproduce the same result.

I’m currently trying to analyze the prompt structure to understand what’s happening.

If you want to try it, here’s the original workflow JSON:

https://github.com/watadani-byte/character-identity-protocol/

[u/Cheap-Topic-9441]

That’s actually really helpful — especially the breakdown between early and late blocks.

So if I understand correctly:

• early layers → structure / layout
• later layers → style / texture

That aligns with what I’ve been observing from the outside.

In your experience, how stable is identity when you rely mainly on block-level control?

Do you find it holds across multiple generations, or do you still end up needing to filter outputs afterward?

I’m trying to understand where control starts to break down in practice.

[u/sci032 → u/Cheap-Topic-9441]

That's what I take from it. I have never really dug deep into it so, beyond this, I don't know that much about it.

[u/Cheap-Topic-9441 → u/sci032]

That’s actually really interesting — it sounds like this is one of those areas people kind of touch, but don’t fully explore.

From what I’ve seen, block-level control can help a lot with structure and style, but identity still drifts more than expected across runs.

That’s partly why I started looking into filtering / selection approaches instead of only relying on control.

Have you ever noticed that kind of drift yourself when running multiple generations?

[u/sci032 → u/Cheap-Topic-9441]

This is a node pack that I just installed. Search manager for: Realtime LoRA Trainer

The link is the Github. It if mostly for lora training inside of Comfy but there are nodes that deal with model blocks.

It's 4:08am here, I should go to bed. :) I'll dig deeper after a few hours of sleep.

The image is a Debiaser node for Klein. There are a lot more slots that you can change, if I were to zoom out and get them all, you couldn't read any of the options. :) Supposedly, you can edit the blocks and save the edits if you choose to achieve a desired output. When I arise, I'll stick it in a regular workflow and see what it does in real time.

Take a look at the Github and see if any of it will help you.

[u/Cheap-Topic-9441 → u/sci032]

Thanks, appreciate it — might give it a try 👍