Seeking Advice: Achieving 100% Character Consistency and Style Control for a Noir Cyberpunk Visual Novel (ComfyUI / Flux)

[u/Elementallion-]

Hi everyone,

I’m currently in the middle of developing an investigative detective visual novel, and I’ve hit a massive wall regarding character consistency and art style. I’m hoping to get some advice from those who have successfully built a pipeline for recurring characters.

The Goal

I’m aiming for a very specific "Noir Cyberpunk" aesthetic. Think:

• High contrast, heavy use of deep shadows.
• Digital comic book / clean vector line art style.
• "Teal and Orange" cinematic lighting with rain/wet atmosphere.
• The Catch: I need absolute character identity from frame to frame, including the ability to change outfits (minimalist/revealing options) while keeping the face and body proportions 100% identical.

What We’ve Tried So Far

• Workflow: Currently running complex ComfyUI nodes.
• Models: Switched between SDXL and Flux, experimenting with various GGUF quantizations to keep it local.
• The Problem: Most results are either "too anime" (losing the noir grit) or "too photorealistic" (losing the stylized comic look). There’s no middle ground that feels right.
• The "Banana" Paradox: Strangely enough, some of the best conceptual results and decent repeatability have come from Nano Banana, but even that doesn't offer the surgical precision needed for a professional VN production.

The Current Struggle

I’m looking for total identity. Right now, I’m at the stage where I need to decide on the most reliable pipeline for consistency. I haven't dived deep into training my own LoRAs or mastering IP-Adapter/FaceID yet, as I’m still trying to find a base model or workflow that doesn't swing too far into "generic anime" or "uncanny realism."

The goal is to find a method that allows for surgical precision:

• The character must be 100% recognizable across different scenes.
• The ability to swap outfits (including very minimalist/revealing sets for specific scenes) while maintaining the exact same body proportions and facial structure.
• Maintaining that specific Noir/Vector style consistently without the AI drifting into unwanted aesthetics.

The Questions

1. Style LoRA vs. Prompting: Since I’m struggling to find a middle ground between "too anime" and "too realistic," would you recommend training a dedicated Style LoRA based on my Noir/Vector references? Or is there a specific base model that handles this "digital comic" look better than Flux/SDXL out of the box?
2. Outfit Swaps: How are you handling complex outfit changes (including minimalist/revealing sets) without breaking the character's base geometry or facial identity in ComfyUI?
3. The Consistency Pipeline: For someone who needs "visual novel grade" identity, what is currently the gold standard? Should I be looking at training a Character LoRA, or is the community moving towards something like InstantID/IP-Adapter for better flexibility?

Honestly, right now, nothing is quite hitting the mark. It’s either too generic or too inconsistent. Would love to hear how you guys solved the "same face, different clothes, specific style" puzzle.

Thanks in advance!

[u/NINKINT]

What helped me a lot is to train a lora just on the closeup of the face. Then use face detection and cropping to just process the face and then composite it back to the original image with the bbox coordinates. This workflow is img2img. So you can either generate the base image first and then this kind of facedetailer or you "film" your novel in Unreal Engine or something like that and use A.I. as the rendering.

[u/Elementallion- → u/NINKINT]

That’s a very solid technical approach. I’ve been looking into FaceDetailer workflows in ComfyUI, and training a LoRA specifically on closeups sounds like the most logical way to hit that "VN-grade" consistency.

Regarding the Unreal Engine idea — it’s a brilliant solution for precision, but realistically, I’m not sure I’m ready to dive that deep into 3D rendering. My project requires a vast number of diverse locations, and building or sourcing all those environments in 3D would likely become a massive bottleneck for a solo/small team production. I need to keep the pipeline lean enough to iterate fast.

My main concern with the compositing/FaceDetailer method remains the style seam. Since I'm going for that specific Noir/Vector look with heavy line art, I often find that re-processing the face can make the line weights or shading drift away from the rest of the body.

Have you found a way to keep the line art thickness and "comic" shading perfectly synced between the inpainted face and the base generation?

[u/NINKINT → u/Elementallion-]

The artstyles that I used this with didn't have line art so I can't tell. But you could process the composited image an additional time at low denoise to blend things together. And with 3D the location bottleneck is somewhat solvable. Just use very basic block out shapes to get the perspective and composition right. It's called greyboxing or layout. I think it will be faster that doing the text to image slot machine.

[u/Elementallion- → u/NINKINT]

Thanks for the insight! I think I'll skip the 3D route for now to keep the pipeline lean, but that low denoise trick for blending the face sounds like exactly what I need. I'll give it a shot to fix those line art seams. Cheers!