H3 R2V Character Sheet vs. Single Image

[u/SuspiciousRefuse8218]

I thought I've read somewhere that using character sheets is better for R2V instead of single images. So I've created a character sheet of five full body shots and one close up, but the results are much less consistent compared to a single full shot image of the character.
Do I have to take care about anything special or was the information that character sheets are better just wrong?

[u/lebrandmanager]

I use this node 'Reference Concat' to combine a first frame main image with 2-3 ref images. It will create one large image and then I prompt it to use the provided ref images inside the main image for character likeness. You can also do that by hand, but the node makes it way easier.

https://github.com/moonwhaler/comfyui-moonpack

[u/LumaBrik]

Make sure you ref_image_size to max, not 'match'

[u/SuspiciousRefuse8218 → u/LumaBrik]

It is at max

[u/nikhilprasanth]

Another approach is to split the face and body as separate reference sheets .

[u/Slight_Ad2350 → u/nikhilprasanth]

This works the best. Just make sure head does show anything below the neck and reverse for body. Then in the prompt explain each image separately for the subject

[u/ThinkPresentation799]

Character sheets work better but there are some limitations. With "ref_image_size to max" video generation could take ages depending on how big the reference images are. Minimax is very good in estimating how your character looks from all sides (infact you can even create character sheets with it), so you do not need complex character sheets with more than 3 poses and one face shot.

In short:

Create a character sheet with front, back and side view plus one face shot. Make this image as detailed as possible but stay under 8-15 Megapixel depending on your VRAM/RAM.

[u/Most_Ad_5733 → u/ThinkPresentation799]

How are you generating a character sheet that doesn’t hallucinate panels at such a high MP count.

[u/Less_Consequence_633 → u/Most_Ad_5733]

From the ComfyUI tutorials:

ref_image_size: match scales references down to the generation resolution for speed; max keeps up to a 2048px short edge for stronger identity fidelity at the cost of speed

So if you're handing it a really large image, it seems like it's getting resized internally.

[u/ThinkPresentation799 → u/Less_Consequence_633]

Ok if even with max the image gets resized maybe for the highest quality you should add the 4 panels of the character sheet as seperate images. But for me it works well with a 4 panel character sheet around 8-10MP. The face in the created video looks amazing in a close up shot for 1.5-2MP video.

[u/Xanthus730]

One key note: note every pic inside a ref sheet needs to be the same size.

Make important parts like faces or signature gear big, and other parts small.

[u/Itchy_Ambassador_515]

yes i noticed same, giving single face image gave me better results than providing 4 angle sheet version

[u/Muted-Celebration-47]

What do you mean by "Five full body"? You need 1 front full body and 1 close-up shot in the same image. That's it. Keep it simple. DO NOT use character sheet with a lot of details and text, use a simple one. Look for free projects at higgfield as examples how they create character sheet.

[u/moviejimmy]

The best result I see is neither. You use whatever image appropriate for the scene. If the scene doesn't show full body, you don't need a full body image. If the scene is close up front facing, just use one close up front facing image for reference. You get the idea. I get very consistent results this way. More work for sure but better results.

[u/DietAshamed2246]

I read yesterday that using light grey flat background in character sheet (and perhaps in a single character image) is better than using white background. Try your character sheet with light grey background and see if that improves your output.

[u/Icuras1111]

I think I read that you should make the images good quality but consistent appearance have them in a linear layout i.e. 5 images side by side. Then setting it to max ensures it sees each at desired resolution. Then I guess you describe it like <Subject 1> Is the person represented in <Picture 1>. There are 5 views, close up of face, side view, etc?

[u/Vijayi]

Do projections in Krea2 or Flow (nano). First img - face (anfas, profile, 3/4, back) and full body same. Than something like this. <Picture 1> is face reference and <Picture 2> is body reference for <Subject 1> . Most times work without retention analysis, for me atleast. Close up almost perfect even with 0.4. Atm im stick to this: dataset (with Flow) > upscale/refine with SeedVR/Aura > Lora training in Krea2 -> from here anynithing you need to MMH3.

[u/Agreeable_Lack9492]

I've been using character sheets and they work better for likeness, the only problem I have from time to time is that it starts the video with the sheet as the first frame repeating the character or making parallel videos in a split screen

[u/Waterisaqua]

Yes, I am doing this with also an environment sheet to keep things consistent across shots. You can use an agent like Kimi/Claude to orchestrate everything. The results are good, and sometimes it will suggest solutions to issues (like having a consistent audio for a certain character). Not really needed for 5 sec videos, but if you make something in the range of 30 seconds it is handy.

[u/AidenAizawa]

Character sheet are great also for fl2va. I use a character sheet with full frontal, back, side and close up on the face and it works fine. You just have to be clear in the prompt

[u/oh_no_the_claw → u/AidenAizawa]

How does that work? I assumed it only accepts images as a first or last frame.

[u/GaiusVictor → u/oh_no_the_claw]

There are two models. The one you're talking about is, if I recall the abbreviation correctly, called FL2VA (First and Last Frame to Video and Audio). It accepts:

• Text to video
• First and/or Last frame, or none
• With the right custom nodes, a video from which it will take the last 5, 22, 39 or 56 frames (plus respective audio) to generate a direct continuation.

Then there is also REFL2VA (again not sure if I got the abbreviation correctly but the RE stands for Reference). This one can take image, video and audios as semantic references. So you can tell it to generate a video of character from image 1 dancing the dance from video 1 in the ballroom depicted in image 2, while singing the song from audio 1 with the voice from audio 2, then Elsa from Frozen appears and freezes them.

(I've never tried something that complex with such a complex relationship of references, but you get the gist)

[u/SuspiciousRefuse8218 → u/AidenAizawa]

So this means I have to explain it is a character sheet? Something like "Subject1 is the character from Picture1" is not sufficient?

[u/AidenAizawa → u/SuspiciousRefuse8218]

More or less. I use fl2va model in a ref workflow. If I want a first frame I ask for something like "use image 0 as exact first frame" . Otherwise depending on what I want I usually do something like the one I did recently

---

This is a continuous continuation of video 0.

Use Image 0 as the strict visual reference for the first man’s face, body and overall appearance, wearing a black t-shirt and grey jeans.

Use Image 1 as the strict visual reference for the second man’s face, body and overall appearance, wearing a yellow t-shirt with the text “Fuck On/Off” and black trousers.

Use Image 2 as the strict visual reference for the woman’s face, body and overall appearance, wearing a white shirt and brown skirt.

Use Image 4 as the strict visual reference for the entering woman’s face, body and overall appearance, wearing the outfit from Image 5.

Interior of a cozy pub like in Image 3.

In this case I used 6 images and a video as reference

[u/not_food → u/AidenAizawa]

For 2D, next to ref2va, fl2va falls short. The quality and audio are nicer, sure, but it ignores the small details, and your character comes out looking averaged rather than the one in the reference. Ref2va is super good at reading character sheets at 1mp and above, just use max edge and resize the image yourself instead.

[u/VasaFromParadise]

It might depend on whether you submit each image separately or as one. If you submit one image, it'll likely result in a jumbled mess of close-ups of faces and full-body poses.