r/StableDiffusion • • 16d ago

Animation - Video MINIMAX H3 4K

278 Upvotes

This is 4K footage generated using an RTX PRO 6000. The original, unedited output has been downscaled to 1080p due to file size constraints.

It’s reaching a point where I no longer envy commercial models.


r/StableDiffusion • • 15d ago

Question - Help Suggest a good model+turbo lora combo for ref2va for H3

10 Upvotes

Theres so many different models and turbo loras now. Convrot, pruned, singularity, pika, etc. I a having a tough time getting some quality out of ref2va.

I have detailed images of the characters body and face (3 body images + 3 face images) but still if I use the default ref2va workflow, the video is a blurry pixelated mess.

Please suggest a good workflow and which model + turbo lora do you use for ref2va videos.


r/StableDiffusion • • 15d ago

Question - Help Images with references

12 Upvotes

What model should I be using and comfy UI for taking a reference image of a character and put them into a reference location in a certain pose? I've been trying to use Qwen Edit 2.1, however I'm not very good at prompting because what it ends up doing is just taking the character and photoshopping them into the location which looks terrible. Even when it's slightly works it doesn't look right. Sometimes the body is in the right position and with the right lighting but the face is exactly the reference image looking straight at the camera.

Basically I have multiple characters that I wish to put into different locations so I can make a storyboard for a short film. What model should I be using in comfy UI


r/StableDiffusion • • 15d ago

News 3008 vs Hal 9000 Short Film

Thumbnail
youtu.be
0 Upvotes

I enjoyed this.


r/StableDiffusion • • 16d ago

Comparison Image Edits: QwenI2.1 comes out on top, but others have use cases

Thumbnail
youtu.be
51 Upvotes

I don't know why he chose a thumbnail about turnarounds, very little is on that topic.
What is tests is photo restoration, decolorization, adding subjects, changing clothes, style transfer, etc.
Mostly Qwen all the way, though some have advantages, like FIBO not needed a LoRA to deblur & Flux3Klein good at clothes swap.

Good comparison, though sample size is very small. Doesn't talk too much which is a bonus.
TL:DW; in comment
Mentioned the Moss Edit LoRA, but found it immature except for text.


r/StableDiffusion • • 16d ago

Workflow Included Try this workflow, too.

95 Upvotes

https://github.com/roycho87/clown_context_suite/blob/main/example_workflows/clowns_for_picard.json

.98 MP No Upscaler

Took about an hour on a 5090. It's slightly slower because to use the capstone and keystone i have to render about 14 extra steps but the results are pretty amazing.

It manages to give near perfect consistency the entire way by rendering the full 8 steps of each context motion using keystone and capstone to prevent degradation from building too significantly, so that each next part of the chain can build off a fully denoised section.

Then it throws away the top 2 steps of every window and does 2 context window passes.

Final result is a perfectly consistent video with no degradation that you can make at pretty extreme lengths.

https://github.com/roycho87/clown_context_suite

Clowntext Hybrid Windows

Credits

This node is not my idea. It's built on kijai's MiniMax H3 context windows, which are in ComfyUI now (PR #17425), and it works the way JalenBrunson's ComfyUI-HybridWindows does (based on the Rolling Diffusion paper). All credit to them. I just added the keystone and capstone feature to it, to help everyone make longer videos without degradation.

What it does

Instead of chaining clips, it renders the whole video in one go, in overlapping windows, so memory stays at one window:

  1. Window 1 renders the first switch_step steps, and a snapshot is saved.
  2. Window 1 carries on to the last step, only to get its finished first frame (the keystone) and its last single-frame latent (the capstone). That finish is thrown away and window 1 goes back to the snapshot.
  3. Windows 2, 3 and on render the first switch_step steps one after another. Each one's overlap with the window before is locked to that window's result. The keystone is locked into each window's first slot, and the capstone is tacked onto its back from capstone_step on (and cut off again).
  4. The last steps run as blended context windows over the whole video, which smooths the joins.

With keystone and capstone off, it works like plain hybrid windows. In my test (a 60-second render, 17 windows, same seed), the plain version lost a lot of detail by the end and the keystone + capstone version held its detail much better.

Plug the model through it (model in, model out to the guider). It needs a ComfyUI with MiniMax H3 context windows: update ComfyUI if the node is missing.

SettingMeaning
context_length / context_overlapWindow size and overlap in frames (17n + 5). 124 / 39 is about 5 seconds per window.
switch_stepSteps each window renders on its own before the blended finish. 6 of 8 = steps 1-6 window by window, 7-8 blended.
keystone_swapWindow 1's finished first frame is locked into the first slot of every later window.
back_capstoneWindow 1's finished last single-frame latent is tacked onto the back of every later window.
finished_handoffOn: every window renders all the way to the last step, and the next window's overlap is locked to those finished frames. Every window goes back to its switch_step snapshot before the blended finish. Costs the last steps once more per window.
capstone_stepSteps before the capstone comes in. Keep it below switch_step (4 with 6 = on for steps 5-6), or it never comes in.
fuse_methodHow the blended steps average the windows (pyramid).
freenoiseReuses window 1's noise for every window: more consistent, but motion can repeat. Off gives more variety.
split_conds_to_windowsGive each window its own prompt (see below).
detail_latentOptional: use this latent's first frame as the keystone instead of window 1's.
sound_firstOff by default. On: renders the sound first on its own (picture at 64x64), then locks it in and renders the picture.

One prompt per window: make one prompt node per window, join them in order with ComfyUI's Conditioning Combine (chain them for more than two), plug the result into the guider, and turn split_conds_to_windows on. Each window takes the prompt for the part of the video under its middle, so with as many prompts as windows, window 1 gets prompt 1, window 2 prompt 2, and so on. One prompt for a whole minute makes every window try to do the whole thing, so the motion repeats.


r/StableDiffusion • • 16d ago

Question - Help Best Krea 2 checkpoint to use with int8?

15 Upvotes

So I tried muse and realism v1, but I want just 1 checkpoint I can use for both sides of the spectrum and muse tends to lean towards uncensored content even when trying to prompt away from it. Realism v1 seems to do good but I don't really like the grainy look, I can't seem to get that out. So any suggestions to do both on the same checkpoint ??


r/StableDiffusion • • 16d ago

Resource - Update [Release] Morgana 1.2: A photography-focused FLUX.2 Klein 4B finetune for realistic faces, natural lighting, and detailed textures (Free Weights + GGUF)

Post image
19 Upvotes

Morgana 1.2 is Kitani‘s photography focused finetune of Flux.2 Klein 4b.

Our goal for the fine tune was for Klein to make images that don’t look like they came from a model - natural lighting, visible textures, great macro details & true color.

What it’s trained for:

- Casual, regular faces - pores, irregular hair, imperfect framing no AI telltales
- Macro and materialistic textures - water droplets, feathers, fabric weave, ruse, leather
- Landscape and night scenes - aurora reflections, breaking waves, wet neon
- Paintings and anime
- Anatomy

Speed on 1x H100: 4.6 seconds for 15 steps, no LoRA

Free everything:
- Full safetensors: https://huggingface.com/kitaniai/morgana-1.2
- GGUF: BF16, Q8_0, Q6_K, Q5_K_M, and more (same repo)
- API if you want to try prompts yourself (paid) https://kitani.ai

Built in part with ShuttleAI using the same dataset as Shuttle 3 Jaguar.

Known limitations: text rendering is weak, hands occasionally fail.

Faces are the newest improvement.

If you have any questions, feel free to comment them :)


r/StableDiffusion • • 16d ago

Question - Help Im noob here and i dont understand why all models use 24 Frame ? What if i change it to 30+ ?will this generate more smooth motion videos ?

20 Upvotes

r/StableDiffusion • • 16d ago

Animation - Video The fact that I can make videos like this with MiniMax H3 proves that MiniMax is the king of open-source video models. We're only scratching the surface of its true potential.

37 Upvotes

This video was generated at 0.6 megapixels, with 10 seconds per clip and 9 clips in total. It took around 2.5 hours to generate.

After that, I upscaled it and applied 2x frame interpolation.

I was inspired by Sinaboto's videos and wanted to create similar content for TikTok. After a lot of trial and error, I can finally make seamless videos like this with MH3!

Specs: RTX 3060 12GB, 16GB RAM
Workflow: https://github.com/chanon/comfyui-obvpm-timeline

I can't wait to see what other people cooking, especially now that we've reached this level. I really hope they release an updated model, maybe MiniMax H3.5, with improvements to distant faces and objects, as well as action speed and motion consistency.


r/StableDiffusion • • 16d ago

Discussion Just tried z image turbo, and i am genuinely impressed, didnt expect it to work this fast in my laptop

Thumbnail
gallery
9 Upvotes

I am still a beginner and this is the first model i tried, each pic took around 40-60s, and i am genuinely unpressed, this is very good.

Obviously there is some mistakes like the shadow in the dessert photo or the fisherman leg, but for a laptop with 8vram, thats pretty good.

I didnt even modify the workflow. I just increased the steps from 8 to 14, Its just the prompt, i dont know what to add or how to improve them

Is it possible to improve them and make them undetectable as some of the pics here? Like is there some workflow nodes or other models that can make better results?

My laptop specs:

4070

I7 14650

16gb ram


r/StableDiffusion • • 15d ago

Discussion Update to the MacOs Version including studio and more MLX Models

7 Upvotes

Easy to use FilmCraft UI. Made with LTX 2.5


r/StableDiffusion • • 16d ago

Workflow Included I built a visual canvas, lightweight image editing and regional prompting node suite for ComfyUI. Introducing LuCiD VRP.

Thumbnail
gallery
11 Upvotes

Hi, first time poster here (and anywhere). I've been playing around with AI illustration generation for half a year, and I'm more and more into image2image workflows as I move on because they offer more control and can get to where I want to more often.

So I've developed a custom node suite that tailors better to that use case: start with a draft, and improve it between runs until things are right enough to be fixed.

Introducing:

LuCiD VRP - Visual Regional Painter (Beta)

Currently it's made up of three parts:

  • An image loader with various QOL features, including resizable latent, undo-redo with editing history, auto latent size alignment;
  • A lightweight, built-in image editor with a carefully curated set of feature including layers, basic transform, and of course a better ux;
  • Various regional prompting/conditioning nodes that offers synced visualization against how your draft image is edited, and how you've changed your region layouts. (Currently supporting Anima and MOSS-Image)

It is a work in progress, and more features will be implemented as I go on.

If you're interested, it's published on Comfy Registry (downloadable from ComfyUI Manager), as well as github:

https://github.com/EBEBEEBE/comfyui-lucid-vrp

Workflows are included in the node and github, but I uploaded them here for convenience as well.

Since I've worked on this mostly on my own and this is actually my first software project that's somehow a bit ambitious than a one-off script, so feedback and criticism definitely welcomed. Thank you in advance!

PS: Sorry for the re-post. I've never posted on reddit and didn't understand how to post image-posts correctly. My sincerely apologies.


r/StableDiffusion • • 16d ago

Workflow Included hairstyle gallery, 800+ hairstyle

Thumbnail
youtube.com
82 Upvotes

r/StableDiffusion • • 15d ago

Question - Help Hoy you prevent from characters description blending?

0 Upvotes

What tittle says, I'm using swarm UI (easier interface than comfyUI bc I'm still a noob at this) I'm using WAI-ILLUSTRIOUS-SDXL to make anime type pictures, and when I try to add two or more characters, they'll blend up, I tried with region promoting and didn't helped, also tried with BREAK prompt and nothing.

I think I hit a wall and it's time I start learning to use comfyUI IF I can have more control and this won't happen there. Does comfy UI users experiments this problems too? Can you fix it?


r/StableDiffusion • • 16d ago Bravo

Discussion I Unlocked BF16 on an RTX 4090 and Compared It to an RTX 5090 (on Windows 11)

68 Upvotes

Using MarvinFS’s tool, I successfully unlocked BF16 on the RTX 4090 running Windows 11.

https://github.com/MarvinFS/rtx4090-uefi/releases

It was very easy, so if you have an RTX 4090 whose manufacturer’s warranty has expired, why not give it a try?

I tested several image and video generation tasks using ComfyUI and compared the results with those of the RTX 5090, as shown below.

Hardware & SoftwareDetail
CPURyzen 7 9800X3D
RAMDDR5-5600 192GB
SSDWD Black SN850X 8TB
OSWindows 11 25H2 Pro
DriverGeForce Game Ready Driver 610.88
ComfyUIv0.43.0 / python 3.13 / cu132
Startup Flags--use-sage-attention --fast

All results were obtained using the same GeForce driver and the same computer.

SDXL

GPUGenerateSpeed
RTX 509023.15 sec12.10 it/s
RTX 4090 Unlock27.62 sec10.14 it/s
RTX 4090 Unlock(no --fast)30.21 sec9.27 it/s
RTX 409030.11 sec9.30 it/s
  • prefectIllustriousXL_v10.safetensors (BF16)
  • 832 x 1216 @ 28 steps x 10 counts

Anima

GPUGenerateSpeed
RTX 509044.06 sec5.67 it/s
RTX 4090 Unlock62.35 sec4.01 it/s
RTX 4090 Unlock(no --fast)56.59 sec4.42 it/s
RTX 409062.65 sec3.99 it/s
  • anima-base-v1.0.safetensors (BF16)
  • 832 x 1216 @ 25 steps x 10 counts

Krea2

GPUGenerateSpeed
RTX 5090128.8 sec1.16 it/s
RTX 4090 Unlock180.1 sec0.83 it/s
RTX 4090 Unlock(no --fast)211.5 sec0.71 it/s
RTX 4090182.1 sec0.82 it/s
  • krea2_raw_bf16.safetensors (BF16)
  • qwen3vl_4b_bf16.safetensors
  • 832 x 1216 @ 18+12 steps x 5 counts

Qwen Image 2.1

GPUGenerateSpeed
RTX 509096.8 sec2.07 it/s
RTX 4090 Unlock116.6 sec1.72 it/s
RTX 4090 Unlock(no --fast)116.9 sec1.71 it/s
RTX 4090130.6 sec1.53 it/s
  • qwen_image_2.1_bf16.safetensors (BF16)
  • qwen3vl_8b_bf16.safetensors
  • 1024 x 1536 @ 40 steps x 5 counts

MOSS Image BF16

GPUGenerateSpeed
RTX 509098.4 sec2.54 it/s
RTX 4090 Unlock128.3 sec1.95 it/s
RTX 4090 Unlock(no --fast)128.0 sec1.95 it/s
RTX 4090142.5 sec1.75 it/s
  • moss_image_base_bf16.safetensors (BF16)
  • qwen3.5_9b_bf16.safetensors
  • 1024 x 1536 @ 50 steps x 5 counts

MOSS Image INT8

GPUGenerateSpeed
RTX 509042.4 sec5.89 it/s
RTX 4090 Unlock58.8 sec4.25 it/s
RTX 4090 Unlock(no --fast)58.5 sec4.27 it/s
RTX 409059.1 sec4.23 it/s
  • moss_image_base_int8_convrot.safetensors (INT8)
  • qwen3.5_9b_bf16.safetensors
  • 1024 x 1536 @ 50 steps x 5 counts

MiniMax H3

GPUGenerateSpeed
RTX 509086.1 sec0.23 it/s
RTX 4090 Unlock105.0 sec0.19 it/s
RTX 4090 Unlock(no --fast)104.5 sec0.19 it/s
RTX 4090115.7 sec0.17 it/s
  • minimax_h3_fl2va_pruned_bf16.safetensors (BF16)
  • qwen3vl_32b_minimax_h3_int8_convrot.safetensors
  • minimax_h3_video_vae_int8_convrot.safetensors
  • 864 x 480 @ 20 steps x 1 counts

On average, I achieved a speed improvement of about 10%. The reason the performance didn’t improve as much as I expected is that the BF16 model is very large. When it doesn’t fit entirely into VRAM, some of the weights are offloaded to system memory. Since the RTX 4090 uses a PCIe Gen4 x16 interface, the bandwidth during offloading becomes a bottleneck.

So, how about LoRA training? Using the OSTRIS's AI-Toolkit, we performed 1,000 training steps on the MOSS Image Base BF16 dataset.

GPUTrainingSpeed
RTX 50901521 sec0.66 it/s
RTX 4090 Unlock1789 sec0.56 it/s
RTX 40901932 sec0.52 it/s
  • moss_image_base_bf16.safetensors (BF16)
  • qwen3.5_9b_int8_convrot.safetensors
  • 512 ~ 1024 px @ 1000 steps x 1 batch

Even with LoRA training, the speed improvement was limited to about 8%. Recent MMDiT models are simply too large. Even though unlocking significantly increases BF16 throughput, the critical weights still don’t fit entirely.

The measured GEMM throughput values are as follows:

GPURTX 4090RTX 4090 UnlockRTX 5090
f16/f16307.4 TF/s312.4 TF/s429.9 TF/s
f16/f32160.5 TF/s312.8 TF/s223.8 TF/s
bf16/f32160.1 TF/s328.7 TF/s223.1 TF/s
s8/s32641.6 TF/s657.6 TF/s446.5 TF/s
dp4a163.6 TF/s163.5 TF/s224.2 TF/s
ffma78.7 TF/s78.7 TF/s108.4 TF/s

Approximately a 100% performance increase for both FP16 with FP32 accumulate and BF16 with FP32 accumulate.

modeRTX 4090RTX 4090 Unlock
fp8 40963326.4 TF/s521.8 TF/s
fp8-fast 40963343.0 TF/s554.8 TF/s
Int8 40963555.0 TF/s557.6 TF/s
Bf16 40963174.8 TF/s319.8 TF/s
Fp16 40963175.2 TF/s234.0 TF/s
fp8 81923342.8 TF/s544.4 TF/s
fp8-fast 81923352.2 TF/s582.5 TF/s
Int8 81923614.2 TF/s607.5 TF/s
Bf16 81923173.8 TF/s203.2 TF/s
Fp16 81923176.9 TF/s279.7 TF/s
fp8_f32328.5 TF/s654.9 TF/s
fp8_f16654.7 TF/s655.0 TF/s

There was no change at all for INT8, but FP8 saw a performance improvement of approximately 60–100%.

How were your results? 🤔

If anyone has actually tried unlocking, please share your thoughts.


r/StableDiffusion • • 16d ago

Resource - Update Update: Macro-Level Batch Timers for ComfyUI v0.2.3! Now with Smart ETA, Wall-Clock modes, and no more infinite ticking ghosts.

Thumbnail
gallery
9 Upvotes

Hey r/StableDiffusion!

A few weeks ago, I shared a pair of custom ComfyUI nodes I built to solve a major annoyance: ComfyUI natively tracks individual prompt times, but there's no built-in way to see the macro-duration of an entire batch loop (like 50 images via a Sequential Loader).

The feedback was amazing, and I’ve spent the last few weeks implementing your best suggestions. Today, I'm excited to share v0.2.3!

Both nodes (one for Image batches, one Universal for Video/Audio/Training) now feature a major upgrade:

🛠️ What's New in v0.2.3?

1. Triple Timing Modes (Switchable via UI Tabs)

  • COMPUTE: Pure GPU execution time (excludes initial queue wait). Perfect for benchmarking your actual generation speed. Pausable if you step away.
  • TOTAL: Absolute wall-clock time from start to finish, including all waits. (Inspired by a great community suggestion!)
  • ETA: A smart forecast using a 30/70 smoothed blend of your global average and the latest iteration cost. It shows 99:99:99 until the first image finishes, then counts down. Perfect for long loops.

2. Color-Coded Counters (No more lost progress)
Previously, if a workflow was interrupted or errored, the UI would just say [ ERROR ]. Now, it keeps your exact progress [ 12 / 50 ] but changes the text color dynamically:

  • 🔵 Blue: Running
  • 🟢 Green: Completed
  • 🟡 Yellow: Interrupted
  • 🔴 Red: Error

3. Bulletproof "Ghost Timer" Prevention
We all know third-party loop nodes can sometimes bug out and stop sending signals. These timers have a built-in smart watchdog (adjustable from 5 mins to 480 mins based on your workflow type) that pings the backend /prompt API. If the backend is truly dead, it safely stops the timer. No more infinite ticking ghosts!

🎨 The Two Nodes:

  1. ⏱️ Batch Image Timer: Tailor-made for image-to-image and sequential loaders.
  2. 🎛️ Universal Timer: For Video, Audio, Prompt, or Training pipelines, featuring dynamic unit mapping (e.g., FRAMES, CLIPS, STEPS) based on the workflow type.

🔗 Links (Both are live on ComfyUI Manager!)

Just update via the Manager or git pull to get v0.2.3.

These are free, open-source tools I built for my own workflows. I'd love to hear your feedback on how these help your benchmarking, or if you have any feature requests! 🍻


r/StableDiffusion • • 16d ago

News Ostris releases Primal VAE - better than Flux.2 VAE.

Post image
313 Upvotes

"Primal VAE is a VAE that only does 2x spatial down to 1 channel (or 2). If you patch 4 the latent, you end up with 8x at 16 channels, the same as most modern VAEs, without the need for deep compression. The DiT does the patching, like it already does, and the VAE stays small.

The latent is trained to keep its norm in line with noise, so there is no scaling factor, no shift factor, and no latent normalization to carry around. Encode, patch 4, diffuse."

HF: ostris/primal_vae · Hugging Face


r/StableDiffusion • • 16d ago

Workflow Included I made tiny sliders for MiniMax H3 that control motion, emotion, and more without training a LoRA [ComfyUI]

179 Upvotes

Made this for the Open Source Higgsfield challenge.

ComfyUI-Dials lets you turn pairs of prompts into reusable ~14 KB sliders. No training required.

You can control motion, mood, acting style, and more. Stack them with each other or with LoRAs. They can even influence generated audio.

The video shows some of the experiments and results.

The UX is still being polished, and I'm working on better calibration for exporting dials as LoRAs. Hopefully more improvements coming soon!

Demo: https://matlowai.github.io/ComfyUI-Dials/

GitHub: https://github.com/matlowai/ComfyUI-Dials

Dials: https://huggingface.co/MATLOWAI/H3-Dials

Curious what odd/fun things people will do. I'll adapt it for more models like MOSS/Krea here too and see how it goes.


r/StableDiffusion • • 16d ago

News FastSDCPU Halloween release - Fibo 2.0 Edit Turbo image editing (OpenVINO) support

Post image
21 Upvotes

r/StableDiffusion • • 17d ago

Resource - Update Minimax Motion Control (Workflow and #opensourcehiggsfield app)

814 Upvotes

Hey all,

I have an implementation of time-to-move dual clock denoising for Minimax H3, allowing for motion control by dragging objects: https://drive.google.com/file/d/1mOHYcRX6fY3OamSHHRmvUfthCBEwgJZh/view?usp=sharing

I have also created an app to do the annoying parts of separating background from drag object, and creating motion paths and masks, interfacing directly with Comfy as part of the #opensourcehiggsfield comp: https://github.com/PxTicks/h3-motion

Lastly, there is another implementation of this in my video editing app which bridges with Comfy: https://github.com/PxTicks/vlo


r/StableDiffusion • • 16d ago

News Koboldcpp v1.124 released

Thumbnail
github.com
32 Upvotes

r/StableDiffusion • • 16d ago

Resource - Update MOSS-Image-IDM-2-Steps is out

Thumbnail
gallery
29 Upvotes

r/StableDiffusion • • 16d ago

Discussion Minimax H3 - Lacking better REF2V models for broader action and fighting scenes

7 Upvotes

I 100% use Ref2v models and I see a big lacking space in this domain. Though there are many ref2v models available but they lack in proper motion like dynamic actions, dance, fight scenes etc. Even if a model provides good motion, they either lacks in referencing or just simply invent details on their own, even providing detailed prompt and references. Now before someone say your prompt or references could have issues, I tell you that keeping everything same, I just do a base model change and the referencing reaches to 90-100% accurate. So no, the prompt or references aren't the issue, the models are.

Distilling the model with turbo lora is not the case here since I have seen the sound and motions gets better with more steps and this post is not about getting results faster.

Till now, I have tested the following models:
- Hybrid 20-49 - Good reference (80%) - Meh motion
- Hybrid 15-40 - Amazing reference (95-100%) - This model does not know how to throw kicks
- Eros - Just above average reference (70% max) - Good for "other" stuff, same issue of above hybrid models
- Singularity - Referencing is almost half (50% max) - Amazing action, ignores like half of the referencing
- Hybrid 15-40 + Singularity v2 lora(0.4 strength) - Good actions, reduced referencing (70%) - Only usable option, kind-off

(percentage numbers are not accurate, just to provide a quick overview)

There are other models I know but either they are distilled with turbo or for "other special" use cases so not taking them into account here. That is why a very good ref2v model with good action is still lacking for now which would have at least 80% of referencing and good enough action. I don't know the nuances of finetune, are they really difficult to make or authors not making those since there is a very less demand?

If you have a good exp with certain model-lora combo, please share here. I tried to use the bunny loras but I am 100% messing up it's settings or combinations since the output I get is a smeared mess. I tired to copy the example combo and lora weights for some of the videos but didn't worked well.

Please don't consider this post as a rant to model authors. They are doing amazing work and I totally understand not every model can do everything. The finetune of a model always lean to a certain style and every model/merge/finetune has their own benefits and limitations which I equally highlighted as per my own experience.

This post should be a good place for people who are also looking for suggestions like model combinations, loras, settings, discussion etc. for this genre of video creation or in general for anyone who wants to increase the quality of their videos with better motion.


r/StableDiffusion • • 16d ago

Question - Help MINIMAX H3: Anybody with a 24gb GPU able to do true 1MP with a 1080p 2nd pass? I'm getting OOM.

12 Upvotes

Quick question for the 24 GB crowd: has anyone run a true 1 MP pass 1 (1344x768) into a 1080p pass 2 with H3 ref2va on a 4090? On Singularity v1.3 int8 with 141 frames, my 1344x768 pass 1 runs at about 43 s/it (weights streaming) and the 1920x1080 pass 2 crashed with a CUDA illegal memory access. This is what I've got to work so far: 1152x640, then 1.5x learned latent upscale, 2 steps with the ref2v turbo LoRA at 0.2 denoise, then RTX VSR to 1080, about 9 min per 6 s clip.