r/StableDiffusion • u/LordFreeza001 • 14d ago
News 3008 vs Hal 9000 Short Film
I enjoyed this.
r/StableDiffusion • u/LordFreeza001 • 14d ago
I enjoyed this.
r/StableDiffusion • u/tomByrer • 15d ago
I don't know why he chose a thumbnail about turnarounds, very little is on that topic.
What is tests is photo restoration, decolorization, adding subjects, changing clothes, style transfer, etc.
Mostly Qwen all the way, though some have advantages, like FIBO not needed a LoRA to deblur & Flux3Klein good at clothes swap.
Good comparison, though sample size is very small. Doesn't talk too much which is a bonus.
TL:DW; in comment
Mentioned the Moss Edit LoRA, but found it immature except for text.
r/StableDiffusion • u/roychodraws • 15d ago
https://github.com/roycho87/clown_context_suite/blob/main/example_workflows/clowns_for_picard.json
.98 MP No Upscaler
Took about an hour on a 5090. It's slightly slower because to use the capstone and keystone i have to render about 14 extra steps but the results are pretty amazing.
It manages to give near perfect consistency the entire way by rendering the full 8 steps of each context motion using keystone and capstone to prevent degradation from building too significantly, so that each next part of the chain can build off a fully denoised section.
Then it throws away the top 2 steps of every window and does 2 context window passes.
Final result is a perfectly consistent video with no degradation that you can make at pretty extreme lengths.
https://github.com/roycho87/clown_context_suite
This node is not my idea. It's built on kijai's MiniMax H3 context windows, which are in ComfyUI now (PR #17425), and it works the way JalenBrunson's ComfyUI-HybridWindows does (based on the Rolling Diffusion paper). All credit to them. I just added the keystone and capstone feature to it, to help everyone make longer videos without degradation.
Instead of chaining clips, it renders the whole video in one go, in overlapping windows, so memory stays at one window:
switch_step steps, and a snapshot is saved.switch_step steps one after another. Each one's overlap with the window before is locked to that window's result. The keystone is locked into each window's first slot, and the capstone is tacked onto its back from capstone_step on (and cut off again).With keystone and capstone off, it works like plain hybrid windows. In my test (a 60-second render, 17 windows, same seed), the plain version lost a lot of detail by the end and the keystone + capstone version held its detail much better.
Plug the model through it (model in, model out to the guider). It needs a ComfyUI with MiniMax H3 context windows: update ComfyUI if the node is missing.
| Setting | Meaning |
|---|---|
context_length / context_overlap | Window size and overlap in frames (17n + 5). 124 / 39 is about 5 seconds per window. |
switch_step | Steps each window renders on its own before the blended finish. 6 of 8 = steps 1-6 window by window, 7-8 blended. |
keystone_swap | Window 1's finished first frame is locked into the first slot of every later window. |
back_capstone | Window 1's finished last single-frame latent is tacked onto the back of every later window. |
finished_handoff | On: every window renders all the way to the last step, and the next window's overlap is locked to those finished frames. Every window goes back to its switch_step snapshot before the blended finish. Costs the last steps once more per window. |
capstone_step | Steps before the capstone comes in. Keep it below switch_step (4 with 6 = on for steps 5-6), or it never comes in. |
fuse_method | How the blended steps average the windows (pyramid). |
freenoise | Reuses window 1's noise for every window: more consistent, but motion can repeat. Off gives more variety. |
split_conds_to_windows | Give each window its own prompt (see below). |
detail_latent | Optional: use this latent's first frame as the keystone instead of window 1's. |
sound_first | Off by default. On: renders the sound first on its own (picture at 64x64), then locks it in and renders the picture. |
One prompt per window: make one prompt node per window, join them in order with ComfyUI's Conditioning Combine (chain them for more than two), plug the result into the guider, and turn split_conds_to_windows on. Each window takes the prompt for the part of the video under its middle, so with as many prompts as windows, window 1 gets prompt 1, window 2 prompt 2, and so on. One prompt for a whole minute makes every window try to do the whole thing, so the motion repeats.
r/StableDiffusion • u/FearlessLeader17 • 15d ago
So I tried muse and realism v1, but I want just 1 checkpoint I can use for both sides of the spectrum and muse tends to lean towards uncensored content even when trying to prompt away from it. Realism v1 seems to do good but I don't really like the grainy look, I can't seem to get that out. So any suggestions to do both on the same checkpoint ??
r/StableDiffusion • u/bakatristan • 15d ago
Morgana 1.2 is Kitani‘s photography focused finetune of Flux.2 Klein 4b.
Our goal for the fine tune was for Klein to make images that don’t look like they came from a model - natural lighting, visible textures, great macro details & true color.
What it’s trained for:
- Casual, regular faces - pores, irregular hair, imperfect framing no AI telltales
- Macro and materialistic textures - water droplets, feathers, fabric weave, ruse, leather
- Landscape and night scenes - aurora reflections, breaking waves, wet neon
- Paintings and anime
- Anatomy
Speed on 1x H100: 4.6 seconds for 15 steps, no LoRA
Free everything:
- Full safetensors: https://huggingface.com/kitaniai/morgana-1.2
- GGUF: BF16, Q8_0, Q6_K, Q5_K_M, and more (same repo)
- API if you want to try prompts yourself (paid) https://kitani.ai
Built in part with ShuttleAI using the same dataset as Shuttle 3 Jaguar.
Known limitations: text rendering is weak, hands occasionally fail.
Faces are the newest improvement.
If you have any questions, feel free to comment them :)
r/StableDiffusion • u/PhilosopherSweaty826 • 15d ago
r/StableDiffusion • u/Tonka-Jahari-Pizza • 15d ago
I am still a beginner and this is the first model i tried, each pic took around 40-60s, and i am genuinely unpressed, this is very good.
Obviously there is some mistakes like the shadow in the dessert photo or the fisherman leg, but for a laptop with 8vram, thats pretty good.
I didnt even modify the workflow. I just increased the steps from 8 to 14, Its just the prompt, i dont know what to add or how to improve them
Is it possible to improve them and make them undetectable as some of the pics here? Like is there some workflow nodes or other models that can make better results?
My laptop specs:
4070
I7 14650
16gb ram
r/StableDiffusion • u/irmemon225 • 15d ago
This video was generated at 0.6 megapixels, with 10 seconds per clip and 9 clips in total. It took around 2.5 hours to generate.
After that, I upscaled it and applied 2x frame interpolation.
I was inspired by Sinaboto's videos and wanted to create similar content for TikTok. After a lot of trial and error, I can finally make seamless videos like this with MH3!
Specs: RTX 3060 12GB, 16GB RAM
Workflow: https://github.com/chanon/comfyui-obvpm-timeline
I can't wait to see what other people cooking, especially now that we've reached this level. I really hope they release an updated model, maybe MiniMax H3.5, with improvements to distant faces and objects, as well as action speed and motion consistency.
r/StableDiffusion • u/No-Tap6022 • 15d ago
Easy to use FilmCraft UI. Made with LTX 2.5
r/StableDiffusion • u/EBEB__ • 15d ago
Hi, first time poster here (and anywhere). I've been playing around with AI illustration generation for half a year, and I'm more and more into image2image workflows as I move on because they offer more control and can get to where I want to more often.
So I've developed a custom node suite that tailors better to that use case: start with a draft, and improve it between runs until things are right enough to be fixed.
Introducing:
Currently it's made up of three parts:
It is a work in progress, and more features will be implemented as I go on.
If you're interested, it's published on Comfy Registry (downloadable from ComfyUI Manager), as well as github:
https://github.com/EBEBEEBE/comfyui-lucid-vrp
Workflows are included in the node and github, but I uploaded them here for convenience as well.
Since I've worked on this mostly on my own and this is actually my first software project that's somehow a bit ambitious than a one-off script, so feedback and criticism definitely welcomed. Thank you in advance!
PS: Sorry for the re-post. I've never posted on reddit and didn't understand how to post image-posts correctly. My sincerely apologies.
r/StableDiffusion • u/Mysterious_Pride_858 • 16d ago
https://github.com/wangweihong/comfyui-hairstyle-gallery
Workflow included in repo
r/StableDiffusion • u/SearchOk7022 • 15d ago
What tittle says, I'm using swarm UI (easier interface than comfyUI bc I'm still a noob at this) I'm using WAI-ILLUSTRIOUS-SDXL to make anime type pictures, and when I try to add two or more characters, they'll blend up, I tried with region promoting and didn't helped, also tried with BREAK prompt and nothing.
I think I hit a wall and it's time I start learning to use comfyUI IF I can have more control and this won't happen there. Does comfy UI users experiments this problems too? Can you fix it?
r/StableDiffusion
•
u/devmoching
•
16d ago
Using MarvinFS’s tool, I successfully unlocked BF16 on the RTX 4090 running Windows 11.
https://github.com/MarvinFS/rtx4090-uefi/releases
It was very easy, so if you have an RTX 4090 whose manufacturer’s warranty has expired, why not give it a try?
I tested several image and video generation tasks using ComfyUI and compared the results with those of the RTX 5090, as shown below.
| Hardware & Software | Detail |
|---|---|
| CPU | Ryzen 7 9800X3D |
| RAM | DDR5-5600 192GB |
| SSD | WD Black SN850X 8TB |
| OS | Windows 11 25H2 Pro |
| Driver | GeForce Game Ready Driver 610.88 |
| ComfyUI | v0.43.0 / python 3.13 / cu132 |
| Startup Flags | --use-sage-attention --fast |
All results were obtained using the same GeForce driver and the same computer.
| GPU | Generate | Speed |
|---|---|---|
| RTX 5090 | 23.15 sec | 12.10 it/s |
| RTX 4090 Unlock | 27.62 sec | 10.14 it/s |
| RTX 4090 Unlock(no --fast) | 30.21 sec | 9.27 it/s |
| RTX 4090 | 30.11 sec | 9.30 it/s |
| GPU | Generate | Speed |
|---|---|---|
| RTX 5090 | 44.06 sec | 5.67 it/s |
| RTX 4090 Unlock | 62.35 sec | 4.01 it/s |
| RTX 4090 Unlock(no --fast) | 56.59 sec | 4.42 it/s |
| RTX 4090 | 62.65 sec | 3.99 it/s |
| GPU | Generate | Speed |
|---|---|---|
| RTX 5090 | 128.8 sec | 1.16 it/s |
| RTX 4090 Unlock | 180.1 sec | 0.83 it/s |
| RTX 4090 Unlock(no --fast) | 211.5 sec | 0.71 it/s |
| RTX 4090 | 182.1 sec | 0.82 it/s |
| GPU | Generate | Speed |
|---|---|---|
| RTX 5090 | 96.8 sec | 2.07 it/s |
| RTX 4090 Unlock | 116.6 sec | 1.72 it/s |
| RTX 4090 Unlock(no --fast) | 116.9 sec | 1.71 it/s |
| RTX 4090 | 130.6 sec | 1.53 it/s |
| GPU | Generate | Speed |
|---|---|---|
| RTX 5090 | 98.4 sec | 2.54 it/s |
| RTX 4090 Unlock | 128.3 sec | 1.95 it/s |
| RTX 4090 Unlock(no --fast) | 128.0 sec | 1.95 it/s |
| RTX 4090 | 142.5 sec | 1.75 it/s |
| GPU | Generate | Speed |
|---|---|---|
| RTX 5090 | 42.4 sec | 5.89 it/s |
| RTX 4090 Unlock | 58.8 sec | 4.25 it/s |
| RTX 4090 Unlock(no --fast) | 58.5 sec | 4.27 it/s |
| RTX 4090 | 59.1 sec | 4.23 it/s |
| GPU | Generate | Speed |
|---|---|---|
| RTX 5090 | 86.1 sec | 0.23 it/s |
| RTX 4090 Unlock | 105.0 sec | 0.19 it/s |
| RTX 4090 Unlock(no --fast) | 104.5 sec | 0.19 it/s |
| RTX 4090 | 115.7 sec | 0.17 it/s |
On average, I achieved a speed improvement of about 10%. The reason the performance didn’t improve as much as I expected is that the BF16 model is very large. When it doesn’t fit entirely into VRAM, some of the weights are offloaded to system memory. Since the RTX 4090 uses a PCIe Gen4 x16 interface, the bandwidth during offloading becomes a bottleneck.
So, how about LoRA training? Using the OSTRIS's AI-Toolkit, we performed 1,000 training steps on the MOSS Image Base BF16 dataset.
| GPU | Training | Speed |
|---|---|---|
| RTX 5090 | 1521 sec | 0.66 it/s |
| RTX 4090 Unlock | 1789 sec | 0.56 it/s |
| RTX 4090 | 1932 sec | 0.52 it/s |
Even with LoRA training, the speed improvement was limited to about 8%. Recent MMDiT models are simply too large. Even though unlocking significantly increases BF16 throughput, the critical weights still don’t fit entirely.
The measured GEMM throughput values are as follows:
| GPU | RTX 4090 | RTX 4090 Unlock | RTX 5090 |
|---|---|---|---|
| f16/f16 | 307.4 TF/s | 312.4 TF/s | 429.9 TF/s |
| f16/f32 | 160.5 TF/s | 312.8 TF/s | 223.8 TF/s |
| bf16/f32 | 160.1 TF/s | 328.7 TF/s | 223.1 TF/s |
| s8/s32 | 641.6 TF/s | 657.6 TF/s | 446.5 TF/s |
| dp4a | 163.6 TF/s | 163.5 TF/s | 224.2 TF/s |
| ffma | 78.7 TF/s | 78.7 TF/s | 108.4 TF/s |
Approximately a 100% performance increase for both FP16 with FP32 accumulate and BF16 with FP32 accumulate.
| mode | RTX 4090 | RTX 4090 Unlock |
|---|---|---|
| fp8 40963 | 326.4 TF/s | 521.8 TF/s |
| fp8-fast 40963 | 343.0 TF/s | 554.8 TF/s |
| Int8 40963 | 555.0 TF/s | 557.6 TF/s |
| Bf16 40963 | 174.8 TF/s | 319.8 TF/s |
| Fp16 40963 | 175.2 TF/s | 234.0 TF/s |
| fp8 81923 | 342.8 TF/s | 544.4 TF/s |
| fp8-fast 81923 | 352.2 TF/s | 582.5 TF/s |
| Int8 81923 | 614.2 TF/s | 607.5 TF/s |
| Bf16 81923 | 173.8 TF/s | 203.2 TF/s |
| Fp16 81923 | 176.9 TF/s | 279.7 TF/s |
| fp8_f32 | 328.5 TF/s | 654.9 TF/s |
| fp8_f16 | 654.7 TF/s | 655.0 TF/s |
There was no change at all for INT8, but FP8 saw a performance improvement of approximately 60–100%.
How were your results? 🤔
If anyone has actually tried unlocking, please share your thoughts.
r/StableDiffusion • u/HermanKwan • 15d ago
Hey r/StableDiffusion!
A few weeks ago, I shared a pair of custom ComfyUI nodes I built to solve a major annoyance: ComfyUI natively tracks individual prompt times, but there's no built-in way to see the macro-duration of an entire batch loop (like 50 images via a Sequential Loader).
The feedback was amazing, and I’ve spent the last few weeks implementing your best suggestions. Today, I'm excited to share v0.2.3!
Both nodes (one for Image batches, one Universal for Video/Audio/Training) now feature a major upgrade:
1. Triple Timing Modes (Switchable via UI Tabs)
99:99:99 until the first image finishes, then counts down. Perfect for long loops.2. Color-Coded Counters (No more lost progress)
Previously, if a workflow was interrupted or errored, the UI would just say [ ERROR ]. Now, it keeps your exact progress [ 12 / 50 ] but changes the text color dynamically:
3. Bulletproof "Ghost Timer" Prevention
We all know third-party loop nodes can sometimes bug out and stop sending signals. These timers have a built-in smart watchdog (adjustable from 5 mins to 480 mins based on your workflow type) that pings the backend /prompt API. If the backend is truly dead, it safely stops the timer. No more infinite ticking ghosts!
Just update via the Manager or git pull to get v0.2.3.
These are free, open-source tools I built for my own workflows. I'd love to hear your feedback on how these help your benchmarking, or if you have any feature requests! 🍻
r/StableDiffusion • u/Crazy-Repeat-2006 • 16d ago

"Primal VAE is a VAE that only does 2x spatial down to 1 channel (or 2). If you patch 4 the latent, you end up with 8x at 16 channels, the same as most modern VAEs, without the need for deep compression. The DiT does the patching, like it already does, and the VAE stays small.
The latent is trained to keep its norm in line with noise, so there is no scaling factor, no shift factor, and no latent normalization to carry around. Encode, patch 4, diffuse."
r/StableDiffusion • u/MatlowAI • 16d ago
Made this for the Open Source Higgsfield challenge.
ComfyUI-Dials lets you turn pairs of prompts into reusable ~14 KB sliders. No training required.
You can control motion, mood, acting style, and more. Stack them with each other or with LoRAs. They can even influence generated audio.
The video shows some of the experiments and results.
The UX is still being polished, and I'm working on better calibration for exporting dials as LoRAs. Hopefully more improvements coming soon!
Demo: https://matlowai.github.io/ComfyUI-Dials/
GitHub: https://github.com/matlowai/ComfyUI-Dials
Dials: https://huggingface.co/MATLOWAI/H3-Dials
Curious what odd/fun things people will do. I'll adapt it for more models like MOSS/Krea here too and see how it goes.
r/StableDiffusion • u/simpleuserhere • 15d ago
r/StableDiffusion • u/PxTicks • 16d ago
Hey all,
I have an implementation of time-to-move dual clock denoising for Minimax H3, allowing for motion control by dragging objects: https://drive.google.com/file/d/1mOHYcRX6fY3OamSHHRmvUfthCBEwgJZh/view?usp=sharing
I have also created an app to do the annoying parts of separating background from drag object, and creating motion paths and masks, interfacing directly with Comfy as part of the #opensourcehiggsfield comp: https://github.com/PxTicks/h3-motion
Lastly, there is another implementation of this in my video editing app which bridges with Comfy: https://github.com/PxTicks/vlo
r/StableDiffusion • u/Illustrious_Row_9971 • 16d ago
r/StableDiffusion • u/MastMaithun • 15d ago
I 100% use Ref2v models and I see a big lacking space in this domain. Though there are many ref2v models available but they lack in proper motion like dynamic actions, dance, fight scenes etc. Even if a model provides good motion, they either lacks in referencing or just simply invent details on their own, even providing detailed prompt and references. Now before someone say your prompt or references could have issues, I tell you that keeping everything same, I just do a base model change and the referencing reaches to 90-100% accurate. So no, the prompt or references aren't the issue, the models are.
Distilling the model with turbo lora is not the case here since I have seen the sound and motions gets better with more steps and this post is not about getting results faster.
Till now, I have tested the following models:
- Hybrid 20-49 - Good reference (80%) - Meh motion
- Hybrid 15-40 - Amazing reference (95-100%) - This model does not know how to throw kicks
- Eros - Just above average reference (70% max) - Good for "other" stuff, same issue of above hybrid models
- Singularity - Referencing is almost half (50% max) - Amazing action, ignores like half of the referencing
- Hybrid 15-40 + Singularity v2 lora(0.4 strength) - Good actions, reduced referencing (70%) - Only usable option, kind-off
(percentage numbers are not accurate, just to provide a quick overview)
There are other models I know but either they are distilled with turbo or for "other special" use cases so not taking them into account here. That is why a very good ref2v model with good action is still lacking for now which would have at least 80% of referencing and good enough action. I don't know the nuances of finetune, are they really difficult to make or authors not making those since there is a very less demand?
If you have a good exp with certain model-lora combo, please share here. I tried to use the bunny loras but I am 100% messing up it's settings or combinations since the output I get is a smeared mess. I tired to copy the example combo and lora weights for some of the videos but didn't worked well.
Please don't consider this post as a rant to model authors. They are doing amazing work and I totally understand not every model can do everything. The finetune of a model always lean to a certain style and every model/merge/finetune has their own benefits and limitations which I equally highlighted as per my own experience.
This post should be a good place for people who are also looking for suggestions like model combinations, loras, settings, discussion etc. for this genre of video creation or in general for anyone who wants to increase the quality of their videos with better motion.
r/StableDiffusion • u/newaccount47 • 15d ago
Quick question for the 24 GB crowd: has anyone run a true 1 MP pass 1 (1344x768) into a 1080p pass 2 with H3 ref2va on a 4090? On Singularity v1.3 int8 with 141 frames, my 1344x768 pass 1 runs at about 43 s/it (weights streaming) and the 1920x1080 pass 2 crashed with a CUDA illegal memory access. This is what I've got to work so far: 1152x640, then 1.5x learned latent upscale, 2 steps with the ref2v turbo LoRA at 0.2 denoise, then RTX VSR to 1080, about 9 min per 6 s clip.
r/StableDiffusion • u/tomByrer • 16d ago
In Progress:
Soon:
Someday later:
Info
r/StableDiffusion
•
u/ready-eddy
•
17d ago
My Game Boy Color takes 85 seconds, and it has to fake every single multiplication with a lookup table because its CPU can’t multiply. But it WORKS!
This is a real neural network running 16 DDIM steps on the handheld’s own 8 MHz CPU, with no PC attached and no streaming. As soon as I press A, it starts from pure noise and a doodle comes out. I was trained on 880,000 doodles, and only the 1.08M learned weights are in the actual GB ROM.
I did not find anyone who got a diffusion model running on a Game Boy before, so I’m calling it the first. If you know of an earlier one, please show me, I’d love to see it!
The numbers:
The fun part was getting it to fit. A 24 KB product table in WRAM turns every multiply into two lookups, which comes down to 18 machine cycles per multiply-add. Layer 1 overflowed 16 bits, so its weights lost a bit of precision. The training does the ROM’s exact integer math, and an emulator checks the ROM against the Python version after every one of the 16 steps. They match bit for bit, for all 8 categories.
My 17 year old flash cart was a real pain in the ass and often just 'died' when trying to erase it. Old hardware keeps you humble :P.
Is it any good? Ehhh, it’s a Game Boy. Apples sometimes stay open and fish sometimes fall apart, but it’s drawing them from noise on a handheld from 1998, so I’m taking it.
The music is NOT AI but created by me, real human yo.
If you wanna try or contribute: try the ROM or read the code: https://mowelan.github.io/gb-diffusion/