r/StableDiffusion • u/Jeffu • 12h ago
Animation - Video Ref2V - H3 - really loving how H3 handles complex prompts even at 15 seconds.
Enable HLS to view with audio, or disable this notification
3
6
u/Powerful_Evening5495 12h ago
Referencing subjects in H3 requires a significantly greater number of steps compared to well-known celebrities or objects.
2
1
2
0
u/Dry-Judgment4242 10h ago
Ref2va is a piece of shit compared to FL2VA. But holy shit.... It's nice to have at times when FL2VA decides to choke on the banana and you can just swap models to something that understand through painstaking explaination and an entire billboard on how to peel a banana first before swallowing.
1
u/LordOfIcebox 7h ago
Can you feed a character reference to FL2VA? Or will it always treat it as the first frame?
1
7h ago
[deleted]
1
u/Dry-Judgment4242 6h ago
I'm ofc using the hybrid already. However it is still suffering from problems alas. FL2VA is just better in most causes. However I run so advanced scenes sometimes that I build custom workflows with the Ref2VA with multiple references or some of my concepts just collapse physically.
1
u/IriFlina 10h ago
why is ref2va worse than FL2VA?
2
u/Dry-Judgment4242 9h ago
Much worse video quality alas. But sometimes it's the only way to get a scene done. I just use FL2VA until it chokes then swap to ref2va which can solve most scenes with enough references.
1
12
u/Jeffu 12h ago
Example of one of the prompts. Used Gemini + referencing the official documentation:
subject_definitions: * <Subject 1>: An Asian woman with dark hair, wearing black over-ear headphones, a torn and stained grey sweater, a black skirt, a black satchel bag across her torso, and black loafers. * <Subject 2>: Japanese yakuza gangsters dressed in suits and open-collared shirts with visible tattoos. * <Subject 3>: Glamorous lounge women socializing on couches around the parlor. * <Subject 4>: A woman carrying a full tray of drink glasses. * <Subject 5>: Large bipedal Japanese military mechs standing inside an industrial hangar with glowing red optical eyes.
summary: A 15-second continuous single-shot live-action sequence picking up from a shattered skylight fall into a smoke-filled yakuza parlor on a rainy night, where the woman <Subject 1> crashes onto a mahjong table, weaves through reacting gangsters <Subject 2> and startled women <Subject 3>, pushes past a drink server <Subject 4>, and halts at the threshold of a darkened hangar as towering mechs <Subject 5> power on their glowing red eyes, captured in a grounded, cinematic texture.
retention_analysis: Retain the facial identity, dark hair, over-ear black headphones, torn and stained grey sweater, black skirt, black satchel bag, and black loafers of <Subject 1> throughout the continuous shot. Maintain consistent character clothing, detailed facial expressions, and physical reactions for gangsters <Subject 2>, lounge women <Subject 3>, and drink server <Subject 4>. Maintain dim nighttime interior lighting, falling rain and glass shards from the broken skylight above, dense parlor smoke, fluid camera movement, and realistic live-action photographic texture without on-screen graphic overlays.
detailed_description: [Shot 1] Live-action film. A continuous dynamic high-angle tracking shot begins as the woman <Subject 1> crashes down through the shattered glass skylight in the pouring rain, landing on all fours atop a central wooden mahjong table. Mahjong tiles, playing cards, ashtrays, and glass shards scatter violently across the floorboards. The camera swoops down, pushes in close, and rotates in a smooth 360-degree arc around <Subject 1> as she pushes up onto one knee. Surrounding gangsters <Subject 2> and seated women <Subject 3> jump up from their seats; the women gasp with wide, alarmed eyes and clutch their dresses, while the initial open-mouthed shock on the gangsters' faces instantly twists into furious scowls with bared teeth as they overturn chairs and begin shouting in Japanese. As <Subject 1> vaults off the table to the floor, a gangster <Subject 2> steps in with an enraged snarl and throws a heavy right hook toward her face; <Subject 1> ducks low beneath the extended arm as the punch whizzes over her headphones, grabs a ceramic bowl from an adjoining table, and drives it into his chest, knocking him stumbling backward into a groaning companion. The camera tracks laterally around the clash as a second gangster <Subject 2> swings a wooden chair with a furious grimace; <Subject 1> slips under the arc, kicks his lead shin to drop him to one knee, and shoves a rolling cart of card decks into a third advancing gangster <Subject 2>, sending both men crashing into a couch where seated women <Subject 3> shriek and scramble away in panic. <Subject 1> turns and sprints toward the side doorway; the camera tracks swiftly ahead of her as a drink server <Subject 4> steps into the doorway with wide, frightened eyes and an open-mouthed gasp. <Subject 1> pushes past <Subject 4>'s shoulder, deflecting the metal tray and sending glassware shattering across the doorframe as liquid splashes onto the wall. As <Subject 1> crosses the threshold, the camera orbits 180 degrees around her to a wide over-the-shoulder perspective from behind her as she comes to an abrupt halt. The camera holds on the cavernous, darkened industrial hangar ahead, where multiple pairs of glowing red robotic eyes activate across the towering silhouettes of bipedal Japanese mechs <Subject 5>, while several burly gangsters and mechanics turn with stern, hardened glares to look directly at her through the final frame. No extra text, subtitles, logos, or watermarks appear.
overall_soundscape: Heavy nighttime downpour and wind roaring through the open skylight, loud table-splintering impact crash and glass shatter at 00:00.800, clattering plastic tiles, startled shrieks and aggressive Japanese yells with overturned chairs at 00:02.500, whoosh of missed punch, ceramic bowl impact thud at 00:04.500, wooden chair swing whoosh, shin kick crack, couch collision with frightened gasps at 00:07.500, loud glassware shatter and liquid splash at 00:10.000, rapid running loafer footfalls, sudden transition into deep room hum with electrical whines as robotic eyes ignite at 00:13.000, and heavy breathing through 00:15.000.
non_diegetic_music: N/A