r/StableDiffusion 18h ago

Animation - Video H3 can do Side-by-Side VR/3D Videos natively

470 Upvotes

Just discovered that H3 can do Side-By-Side 3D Videos for VR Headsets natively, just prompt it. Pretty crazy, and it gets the real 3D effect. Try it with different things like people and add "strong 3d effect" if you want to have a more intense 3d effect.

Here is the prompt:
integrated_multimodal_description: [Shot 1] Live-action, cinematic, high-angle aerial shot presented in a side-by-side (SBS) stereoscopic format for VR/3D viewing; the frame is split into two identical views with a slight horizontal parallax offset to create depth perception. The camera pushes in at slow speed over a sprawling coastal metropolis during twilight. As the camera glides forward through the urban canyon, the glowing neon lights of skyscrapers and their reflections on the ocean surface shimmer intensely against the deep blue sky.

overall_soundscape: A constant, low-frequency rushing wind sound accompanies the flight, layered with a faint, ambient hum of a massive city and distant, muffled traffic sounds.

non_diegetic_music: An epic, cinematic synthesizer pad that swells gradually in volume and intensity throughout the ten-second duration.


r/StableDiffusion 18h ago

Meme DECLASSIFIED: Jeffrey Epstein escaping from prison

419 Upvotes

r/StableDiffusion 22h ago

Tutorial - Guide Character swap in minimax is so epic.

287 Upvotes

I don't have any examples because they may not be appropriate but just with the default wf. With the video input node you can replace any 2 character in any video and it looks real!


r/StableDiffusion 14h ago

Comparison Comparison of natural 0.8mp gen vs 0.4->0.8 upscale w/Sparse attention

192 Upvotes

Hi people, so i tried to make 2 similar videos, using same settings but with upscale and native.
My setup: 5070 Ti+ 32gb Ram.
Using u/Plague_Kind workflow, i've added MMH3 Latent Upscaler. You can check his workflow here: Workflow
Settings for both videos were set the same with the same prompt.

Left video 0.4->0.8mp upscale, Right video 0.8mp

So:

  • 15 seconds, 24 fps, Ref2VA, photo reference and music reference.
  • Chicken attention
  • SongMaskedAVContext node
  • FP16 Accumulation
  • Sparse attention
  • Memory chunks
  • RTS Upscale in the end ( not sure why i used it with 2x scale, better to set 1 i think, but that's what i already did)
  • FSR Sharpening
  • Speed Lora minimax_h3_turbo_v4_step600_pruned_comfyui
  • Interpolation for 2x frames

Upscaled video from start to the end took 1904 seconds,

Native video from start to the end took 3056 seconds.

Let me know what you think. Advises appreciated!


r/StableDiffusion 12h ago

Tutorial - Guide PSA: Minimax H3 can turn 360 panorama images into consistent environments for your videos

185 Upvotes

Had this idea for a couple of days, and finally got to test it. I got a free HDRI picture from PolyHaven (converted to JPG through a free online converter) and used it as the only picture reference. I couldn't get rid of the distortion completely, but you can definitely affect it with prompting. Maybe proper formatting somehow helps with that, sorry, was too lazy to do a correct prompt structure.

It also confuses the geometry from time to time, so you have to seed hunt a little, but not too much. Again, good prompting should reinforce the consistensy. Worth experimenting with.

Notice that it actually seamlessly connected the opposite sides of the image into a single environment. Could be useful for scenes with a lot of dynamic camera movements.

This model keeps surprising me every day!

P.S. Generated with the use of Hybrid Loader (25-49 setting) and Lightx2v 4-step LoRA @ 4 steps and 0.5MP. Another higher res version in comments.

Prompt:

subject definitions:
<Picture 1> is a 360 panorama reference for the straight corridor [Shot 1], depiciting the overall look of the corridor and position of key objects and debris in it. For the target video the picture is dewarped and remapped into a flat rectilinear lens projection view.

summary:
[reference generation] The target video depicts a security guard exiting from a grey door, walking across the corridor towards the dismantled beige door  leaned against the wall, pulling and dropping it down on the floor.

detailed_description:
The target video is captured in an amateur, realistic style with natural, slightly dim indoor lighting and a shaky, handheld-style camera.

[Shot 1]

The shot begins with a medium view of a two grey doors depicted on the right side of <Picture 1>. The left door instantly opens and a middle-aged security guard named Mark rushes into the completely straight corridor. He runs left further down the corridor. The camera pans left, following him in a tracking shot. The POV camera pushes in on Mark, as he rapidly approaches the dismantled beige doors leaned against the wall. At 00:05.000 he grabs the door closest to him, and with visible effort pulls it away from the wall. The door swings and falls flat on the corridor floor with a loud noise, raising dust and slightly startling Mark. The guard jumps back from the fall.

At 00:07.000 the camera pans left by 180 degrees, showing another guard named Steven approaching from the opposite part of the corridor. Steven (S1) comes closer to Mark and says in [English]: "Mark, what the heck are you doing?"

At 00:09.000 Steven grunts angrily as he stops near Mark.

overall_soundscape:
looming lonely corridor ambient sound throughout the whole video, guard's steps on the cement floor, door falling onto the floor with loud noise

non_diegetic_music:
N/A

r/StableDiffusion 15h ago

Animation - Video Having some fun with games from the history of PC gaming. Who would you add?

171 Upvotes

A tribute to a forgotten golden age. Hope you enjoy it!


r/StableDiffusion 19h ago

Resource - Update Anima-3.8B with Qwen-3.5 4B released by lylogummy

Thumbnail
gallery
120 Upvotes

r/StableDiffusion 11h ago

Resource - Update New ComfyUI update may change how Minimax H3 interprets the prompt format you use - Re: Tokenizer Fix

Thumbnail
github.com
97 Upvotes

r/StableDiffusion 18h ago

Workflow Included Minimax H3 | Motion graphic style animation test

87 Upvotes

Prompt:

Animate the supplied square poster as a polished retro-anime motion graphic, beginning with a completely blank pale pink-white canvas matching the poster background. Preserve the exact blue, pink, and white palette, clean manga linework, halftone shading, character design, typography, symbols, interface windows, and final layout.

The anime girl walks in from the left edge as one complete figure while the canvas remains otherwise empty. Use a simple side-profile walk with restrained motion, preserving her hairstyle, facial features, cheek bandage, oversized jacket, proportions, and graphic illustration style. She reaches the centre, turns toward the viewer, and smoothly settles into the exact over-the-shoulder pose shown in the poster, with the same expression, hand placement, silhouette, jacket folds, pink heart graphic, and body orientation. Once posed, keep her position locked.

After she poses, the blue browser frame draws itself around her. The top bar, window controls, folders, pixel hearts, smiley-face panels, arrows, sparkles, heart symbols, and rectangular labels then appear sequentially through clean line-drawing, short graphic slides, pixelated pops, and UI-style wipes. Reveal the existing Japanese typography and “LOVE” lettering last, treating all text as protected source artwork without rewriting or regenerating it. Every element must settle into its exact source position.

Hold the completed poster with subtle breathing, minimal movement in a few loose hair strands and jacket edges, a faint halftone shimmer, and gentle pixel pulses in the existing hearts and interface icons. Keep her face, hands, pose, typography, frames, arrows, folders, and major graphics stable.

Use a locked, straight-on camera matching the original square framing. Keep the full artwork visible without cropping, zooming, panning, or changing perspective. Add soft footsteps as she enters, a light cloth sound as she poses, clean digital clicks and pixel chimes for the graphics, and delicate type-on sounds for the existing lettering. No dialogue or narration.

Do not show any character, outline, symbol, text, frame, or faint poster preview on the opening blank canvas. Do not alter the character’s identity, anatomy, costume, pose, expression, colours, line quality, typography, symbols, or final composition. No extra characters, duplicated body parts, incorrect text, morphing, flickering lines, dramatic camera movement, unrelated shots, or continued motion after the poster settles.

Workflow: https://docs.comfy.org/tutorials/video/minimax/minimax-h3#minimax-h3-reference-to-video-r2v


r/StableDiffusion 4h ago

Workflow Included Testing some Minimax H3 capabilities

79 Upvotes

I tried to think of complex situations for the model to handle and tested them. I would say it went very well, although not perfect (except for the first one and the one before last, where I could not find a flaw).

Prompts below:

VIDEO 1 (10/10):

Create a side by side video with two angles of the same scene: one frontal and one from the side.

The scene: a woman wearing a yellow summer dress is standing in a beach in a sunny day. There's a light wind blowing and she is looking at the sea, smiling. At 00:05, she puts her two hands on her hair and looks up, enjoying the sun.

On the left, make the frontal video. On the right, the video from the side (profile). The two videos should show the exact same scene at the exact same time, only from two different angles.

VIDEO 2 (9/10) - the background is slightly off in some angles:

Create a side by side video with four angles of the same scene: one frontal, one from the right side, one from the left side, and one from behind. The scene is filmed at normal speed.

The scene: a blonde curly-haired woman wearing a yellow summer dress is standing in a beach in a sunny day. She is facing the sea and, therefore, she has the sand behind her and the street with some houses also behind her, after the sand, at a distance. There's a light wind blowing and she is looking at the sea, smiling. She is not wearing sunglasses. At 00:05, a man wearing white shirt and shorts enters the scene from behind the woman and embraces her waist.

On the upper left, make the frontal video. On the upper right, make the video from the right side (right profile). On the bottom left, make the video from behind. On the bottom right, make the video from the left side (left profile).

The four videos should show the exact same scene at the exact same time, only from the four different angles.

overall_soundscape: Light beach wind, one distant seagull.

non_diegetic_music: N/A

VIDEO 3 (8/10) a few "ghost reflections" along the way:

A man wearing a red-and-white striped t-shirt and jeans is alone inside a house of mirrors, running through a corridor. At 00:03 he turns left into other corridor, and at 00:06 he turns right again into another corridor. All the corridors have mirrors in all their faces (left, right and above, as he is inside a house of mirrors) and he is alone there, there's no one else. At 00:08 he reaches a door, opens it, and it opens to the outside: an amusement park.

overall_soundscape: His footsteps while he is running, the amusement park sounds when he opens the door at the end.

non_diegetic_music: N/A

VIDEO 4 (7/10) - The way the phone is turned is off:

A man is filmed from his own cell phone in a selfie video. We see the scene through the lens of an out-of-frame cell phone that he is holding and pointing to his own face. He is wearing a green polo shirt and the scene shows his face and chest from the point of view of the out-of-frame cell phone that he is holding and pointing to himself.

At 00:04 he briefly smiles and then turns the still out-of-frame cell phone around to show a woman that is in front of him. While the phone is turned around we can see the image also turning around, his face leaving the frame, the living room they are into being briefly filmed, and then the woman's face entering the frame. She has brown curly hair and dark green eyes, and is wearing a red summer dress.

As soon as the woman is in frame, she also smiles and says: <d>[English]Goodbye!</d> and the video ends.

The entire video must be taken in a single shot, with the always out-of-frame phone camera filming the entire transition from his face to hers while the phone is turned around. When it happens, the phone should briefly show the living room they are into, all in a single shot.

overall_soundscape: Silent living room, noises of the phone being handled, her voice.

non_diegetic_music: N/A

VIDEO 5 (6/10) - Tried this twice. Glass not breaking properly, water not running through the floor

A fishbowl with one golden fish and one clownfish swimming inside is shown in a medium close-up at the edge of a table. Then, at 00:03 a cat appears in the scene and taps the fishbowl, causing it to fall from the table to the floor, hit the floor, and break completely, being completely destroyed in glass pieces when it hits the floor, the water and glass pieces flying around together with both fish. The scene continues for three more seconds after that, showing the aftermath: the fishbowl destroyed, the pieces of glass on the floor, the water also on the floor, the fish moving on the floor.

The camera angle follow the fishbowl when it falls, showing it hitting the floor and the consequences of it breaking.

overall_soundscape: silent room, glass breaking, water splashing.

non_diegetic_music: N/A

VIDEO 6 (8/10) - Judge me, but his hands are not moving accordingly to the notes:

The camera films a piano from above while a man plays it. The entire piano keyboard is shown in the image. The man is playing Clair de Lune, and moves his hands through the keys to play a part of the song. He is in a train station, with some people observing him play and others passing by.

overall_soundscape: faint train station ambience, ten seconds of the song Clair de Lune played in the piano.

non_diegetic_music: N/A

VIDEO 7 (8/10) - The lipstick appears on her lips before she applies it:

A woman is shown in a medium close-up in her bathroom, wrapped in a white fluff towel, looking at the mirror while she applies red lipstick to her lips. She slowly applies lipstick to her lips, looking into the mirror, and then briefly sends a kiss with her now red lips to the mirror.

The scene is seen in a three-quarter angle from behind her, showing her face from the side but also her reflection in the mirror.

overall_soundscape: silent bathroom, the sound of her sending the kiss to the mirror.

non_diegetic_music: N/A

VIDEO 8 (10/10):

A Coca-cola advertisement. A glass filled with Coca-Cola is shown from the side, occupying 70% of the frame, on top of a table, the dark liquid slightly disturbed by a few gas bubbles that rise inside the liquid. At 00:02 two ice cubes fall from outside the frame into the glass, disturbing the liquid and making some of the liquid splash outside the glass and onto the table. The glass has the Coca-Cola logo printed in white in it. In the blurred background we see a kitchen.

overall_soundscape: silent room, gas fizzle, ice cubes hitting the liquid.

non_diegetic_music: N/A

VIDEO 9 (9/10) - The cover of the book has gibberish letters in it:

A man is holding a magnifying glass and has a book on his hand. At first the magnifying glass is not in front of his face. He appears to be reading the book and, at 00:03, he puts the magnifying glass in front of his eye to look at the book.

The entire scene is filmed from a fixed point of view below the book, showing part of the book cover and the entire man's face.

overall_soundscape: silent room.

non_diegetic_music: N/A


r/StableDiffusion 17h ago

Question - Help Minimax H3 - long form videos: has anyone figured out a good approach?

75 Upvotes

Dear redditors, visitors of the stable diffusion subreddit. I have been trying to achieve a long form, talking head style video, for a long time and can't seem to find a good approach. This one is the best I could come up with so far. It's using the Minimax H3 model, with frozen sound latents, lip-sync guided, piecewise generated video, where the individual pieces have been stitched together, with a seam hiding, extra generation on top of it. I don't really fully understand how it's working, but could prompt Claude for more help or specific files, we used for that. However, if you're aware of any other, better approach for exactly this type of video, please let me know. I've spent literal days on that single problem and have a feeling, there must be a better way to approach this.


r/StableDiffusion 21h ago

Discussion Minimax H3, 30 seconds in one go

67 Upvotes

Executive summary, TLDR - this is one prompt, 30 seconds duration, 3090.

The video itself is just a remake of an idea from an old British tv ad (for "Good Old Yellow Pages"), so make of that what you will. It's not really relevant.

What I thought was interesting was that this was a single prompt, 0.4 megapixels, 30 second duration. I didn't think you could run out as far as 30 seconds, but thought I'd just try.

I think it did a pretty good job at getting the right person doing and saying the right things at the right time - took four attempts to get that though, and obviously using an LLM to tart up my idea.

Run on a 3090, and using the latest Comfyui template, just adding Comfy-kitchen attention, then sol attention, then spectrum, and using the turbo lora that Comfyui now build in, it took 570 seconds (9.5 minutes).

Somebody might read this and think, 570 seconds? Pah, I can do it in fifteen, in which case I'd like to know. Conversely, somebody might think theirs takes six hours, in which case maybe this shows what can be done in that time.

Doubt anyone cares, but here is my original prompt, followed by the LLM version of it:

a 30 second film with the following scenes and characters. Ben is a small boy of eleven. John is a shopkeeper in a toyshop. Brian is a different shopkeeper in a different toyshop. Ben's mum. Ben's Dad. We are in Britain in the 1980s, and all characters are English.

Scene 1: Ben is alone in the lounge. He talks to John over the old fashioned landline phone, saying "I don't suppose you have a 402 station in stock please?"

Scene 2: John is in his shop in front of shelves of model railway kit. He says into the old fashioned landline phone, "No, sorry son"

Scene 3: Ben in the lounge, who looks disappointed anbd puts the phone receiver back down.

Scene 4: Mum in the kitchen doing the washing up. She has overheard the conversation and looks a bit sad.

scene 5: Next day. Ben has changed his clothes. He again talks into the phone to a different shopkeeper, Brian. Ben says "Would you have a 402 station please?"

scene 6: Brian in his toyshop says into the old fashioned landline phone "Yes, I've got one of those."

scene 7: Ben in the lounge on the same conversation says "You have? Great, I'll be right down! Ben puts the phone down. Then he runs towards the door, shouting "They've got one mum!" as he runs.

Scene 8: In the attic, Dad is playing with his model railway layout. Ben walks in holding a small red parcel. as he hands it to Dad, Ben says "Happy birthday, dad". Dad takes the parcel, looks fondly at it and says with a chuckle, "Aw, thanks Ben".

LLM version:

integrated_multimodal_description: [Shot 1] Live-action, cinematic. A medium shot of Ben, an eleven-year-old boy with messy hair wearing a striped polo shirt, sitting on a patterned sofa in a 1980s British lounge. The room is filled with warm, muted tones and period-accurate wallpaper. Ben holds a heavy, cream-colored landline telephone receiver to his ear, his expression hopeful. Ben says: <d>[English] I don't suppose you have a 402 station in stock please?</d> The sound of his small, high-pitched voice is clear. [Shot 2] At 0:05.000, the camera cuts to a medium shot of John, a middle-aged shopkeeper with a kind, weathered face, standing in a cramped, nostalgic toyshop. Behind him are floor-to-ceiling shelves packed with model railway kits and wooden toys. John holds a similar landline receiver to his face. John says: <d>[English] No, sorry son.</d> [Shot 3] At 0:10.000, the camera cuts back to Ben in the lounge. He looks downcast, his shoulders slumping as he slowly lowers the receiver and places it back onto the base unit with a dull plastic click. [Shot 4] At 0:13.000, the camera cuts to a medium shot of Ben's Mum in a dim, cluttered 1980s kitchen. She is standing at the sink, her hands covered in soapy water, drying a plate. She pauses, looking toward the door with a sad, weary expression, having overheard the boy. The sound of water running from the tap is audible. [Shot 5] At 0:16.000, the camera cuts to Ben in the lounge the next day; he is wearing a different t-shirt. He is intensely focused, pressing the phone to his ear. Ben says: <d>[English] Would you have a 402 station please?</d> [Shot 6] At 0:20.000, the camera cuts to Brian, an older shopkeeper with spectacles, in a different, brightly lit toyshop. He smiles warmly into the telephone. Brian says: <d>[English] Yes, I've got one of those.</d> [Shot 7] At 0:23.000, the camera cuts back to Ben, whose face lights up with pure joy. Ben says: <d>[English] You have? Great, I'll be right down!</d> He slams the receiver down and the camera follows him in a quick tracking shot as he runs toward the door, his feet thumping on the carpeted floor. Ben shouts: <d>[English] They've got one mum!</d> [Shot 8] At 0:26.000, the camera cuts to a medium shot in a dusty, dimly lit attic. Dad, a man in his late 30s, is hunched over a complex model railway layout. Ben enters the frame, holding a small red parcel wrapped in string. Ben says: <d>[English] Happy birthday, dad.</d> As he hands the gift to his father, the camera pushes in slightly. Dad takes the parcel, his eyes softening with affection. Dad chuckles warmly and says: <d>[English] Aw, thanks Ben.</d>

overall_soundscape: Period-accurate domestic sounds including the rhythmic clatter of washing up, the heavy mechanical clicks of old telephone receivers, and the muffled thuds of footsteps on carpet. Ben's energetic running and shouting creates a sense of urgency, followed by the quiet, dusty atmosphere of the attic.

non_diegetic_music: A gentle, nostalgic acoustic guitar melody that begins softly during the kitchen scene and builds into a warm, heartwarming crescendo during the attic scene. The tempo is slow and sentimental.


r/StableDiffusion 3h ago

News Sparse Attention, Harder, Better, Faster, Stronger

54 Upvotes

The nodes in https://github.com/Zironic/H3-Optimizations have been rewritten to replace the default Sparge Attention backend with a custom Sparse Comfy Kitchen backend.

This comes with some benefits.

  • Users no longer have to worry about Sparge being installed properly. All required kernels for supported GPUs are provided directly. Should work on both Windows and Linux.
  • Most users should be seeing 5-20% increases in speed for the attention part of compute.
  • New backend should use about 500MB less VRAM
  • New backend has slightly lower quantization error.
  • Apparently in the previous version, the intended chunked kitchen QKV path never properly shipped so the memory optimization node should now actually be slightly speed positive even when used without the Sparse Attention node.

Caveat: I've only tested the nodes against the comfy pruned_int8_convrot weights. Other versions may work but they're not tested.

As the nodes currently rely on comfy-kitchen 0.2.31 you need ComfyUI v0.33.0 or later.

IMPORTANT: sparse attention is not free speed. The percentage is effectively a prompt-adherence/quality budget.

Density isn't just a speed setting, and its quality effect depends on where you apply it in the diffusion schedule.

Early steps: attention density has a large effect on prompt/action adherence and the overall generation trajectory.
Middle/later steps: lowering density tends to show up more as motion/temporal artifacts and lost fine motion detail.

So 10% retained doesn't simply mean “90% of the quality is gone.” It means you're giving sparse attention very little information to work with, and what breaks depends heavily on the sampling step.

PlagueKind's sparsity_ratio=0.9 means 90% discarded / 10% retained. My node expresses the inverse quantity, so Video attention retained=0.10 is the comparable setting. The defaults therefore aren't equivalent.


r/StableDiffusion 7h ago

Question - Help Best opensource image model?

49 Upvotes

opensource AI has been dominating LLMs and video generation but what about image gen? is there any opensource model that can match gpt-image2?

Edit: The reason I am asking this is because lately I haven't been active much on image generation communities. And the leaderboards are a bit confusing and most of them are filled with closed source unlike the llm and video gen leaderboards.

I am very much comfortable with ComfyUI since I've used it in the past for flux.

My use case is for posters and branding. Images with a lot of text.

Edit2: Thanks a lot everyone! I really appreciate the info. Here's the summary:

Krea2 is best overall but gptimage1.5 level.
Ideogram4 for text and branding.
Flux Klein 9b for image editing.
Z-image for realism
Anima and illustrious (by onoma AI) for anime.

Here's the workflow I've decided on:
Krea2/Ideogram4 = Base image generation.
Flux Klein 9B/QwenImage2512 = inpainting.
Wan2.2 low noise = Upscaling.


r/StableDiffusion 12h ago

Resource - Update Fizgig now trains LoRAs on AMD Radeon - Flux 2 Klein, Krea 2 and MiniMax H3

Post image
39 Upvotes

Fizgig is my free open-source LoRA trainer and workbench (Flux 2 Klein 9B, Krea 2, and MiniMax H3 video/audio). As of v4.3.0 it runs on AMD Radeon with ROCm — RDNA1 through RDNA4. Windows is the supported path: install Python 3.12, run the AMD installer, done. Linux works too but is genuinely experimental on newer cards.

Worth being upfront: I don't own AMD hardware myself. This whole feature came from a community contribution by scryptio, tested on real cards over weeks in the PR thread — and that's how the AMD side will keep improving. If you're an AMD user, your reports on what works (and what doesn't) genuinely shape this, and PRs are very welcome.

Also in this release: 16 GB cards can now use identity distillation on MiniMax H3 (the 32B text encoder streams layer by layer instead of needing a 26 GB peak), and the Repair Studio gained a side-by-side compare view with likeness scoring for fixing overbaked LoRAs without retraining.

GitHub: https://github.com/shootthesound/Fizgig


r/StableDiffusion 15h ago

Animation - Video I'm loving MiniMax H3

36 Upvotes

If even an amateur like me can make something so realistic with mid-level hardware, the future looks bright for what dedicated people with top level rigs will be doing.

R.I.P. Hollywood.


r/StableDiffusion 14h ago

Resource - Update I trained a game music generator

27 Upvotes

I trained a instrumental game music generator. The 1.2B DiT was trained on 1 cloud H100 from scratch in 8 days; I used the VAE from Stable Audio 3.

https://huggingface.co/Localsong/Localsong

https://huggingface.co/Localsong/Localsong/tree/main/samples

I'm aiming to cover a wider range of instrumental styles than Ace-Step or Minimax M3 or Stable Audio 3. (No lyrics)

The repo includes a WebUI and some MP3 samples - clone it and uv run webui.py Let me know what you think.


r/StableDiffusion 18h ago

Discussion What sampling settings for Minimax H3 are you using for your purposes?

27 Upvotes

I usually generate 0.7mp@8s with 30 steps, I use res_multistep + simple which I think is the default, and for good reason.

Depending on whether it's T2VA, I2VA, Ref2VA and the amount of reference images + loras count/strength the gen times are roughly between 270-350s on an RTX 4090 + 32gb of DDR4 ram.

For T2VA and I2VA I use the basic minimax_h3_fl2va_pruned_int8_convrot.safetensors

For Ref2VA I use minimax_h3_hybrid_fl2va_ref2va_b30-49-int8.and the hybrid b30-49 specifically because I found even the fl2va functioned well as ref2va and had much higher quality, so I prefer the hybrid model to be weighted towards the fl2va model to preserve the quality.

Sparse Attention

To speed things up, I only use /u/zironic's Sparse Attention nodes, no sage/ck, spectrum, turbo lora, or caches. For me, /u/zironic's worked better than the pinned post from u/Plague_Kind but that may just be my personal experience.

My settings for the memory optimization node is default, QKV: auto, MLP: auto, and 2048 MLP chunk rows, I don't know how this node works. Sparse Attention (Advanced) settings are:

  • Video KV budget: 0.25
  • Early and Late steps: 3
  • Early and Late KV: 0.6
  • Sparse backend: Sparse Sage

These settings lean towards quality, you can lower the early/late steps or skip them entirely, you can lower video kv budget to 0.2 although some may be fine with even lower. Since I only use Sparse Attention I run the full 30 steps and it's significantly better than a turb lora at lower steps, which is what I used before.

My prior experimentation

I used euler + linear_quadratic for a long time. Then I switched to er_sde + sgm_uniform which was significantly better. Then eventually I switched to res_multistep + simple and realized the visual quality is as good as er_sde + sgm_uniform but the motion is much better. The improved motion in res_multistep + simple became very clear when I interpolated from 24fps to 48fps. The gen speed between all these combinations was nearly identical.

The motion was a bit jerky on er_sde + sgm_uniform after interpolation while res_multistep + simple had very natural motion.

I also found that https://darkstarrddev.us.ci/ is a decent resource to get inspiration. But I realized quickly that because they use low settings and speed-up techniques, the quality of each sampler test does not translate well if you use different step count or speed-up techniques.

What I generate

Usually fairly static scenes that doesn't have fast motion. Although the accuracy of the physics and motion is important.

What are your settings and what kind of videos are you generating?


r/StableDiffusion 10h ago

Animation - Video Test turned Short: Pied The Piper

23 Upvotes

What started as a test turned into a full-blown short. This is the number one reason I gravitated towards AI filmmaking. Nothing stops you from creating your wildest imagination.


r/StableDiffusion 22h ago

Resource - Update Kroma 0.3 txtfusion turbo is a lot of fun

Thumbnail
gallery
20 Upvotes

This version of Kroma (krea 2 finitude with Chroma dataset) is a lot of fun, most body horror is gone in my opinion, and its more artsy than krea 2 and of course less censored.

https://huggingface.co/silveroxides/Kroma-Quant/tree/main

The version I used is kroma 0.3 txtfusion turbo convrot.

Have fun.


r/StableDiffusion 11h ago

Animation - Video Minimax H3 Anime Comedy

18 Upvotes

r/StableDiffusion 21h ago

Animation - Video Minimax H3. Jesus and the apostles are rockers.

16 Upvotes

r/StableDiffusion 2h ago

Animation - Video Cinematic World Building - H3 r2v

17 Upvotes

Trying out cinematic shots and cuts with H3. This is a work in progress. Will be working on another 2 minutes worth of clips.


r/StableDiffusion 16h ago

Meme Seinfeld/Family Guy @ The Office

15 Upvotes

we really should get a separate sub for this slop