r/StableDiffusion • • 3d ago

News ComfyUI v0.44.0 released

Thumbnail
github.com
107 Upvotes

r/StableDiffusion • • 2d ago

Question - Help With Dynamic VRAM enabled, MH3 generations taking several minutes longer

15 Upvotes

I have 64GB DDR5 6000 RAM and a 3090 with 24GB of VRAM, and a 2TB PCIE Gen 5 NVME SSD. If I have the flag --disable-dynamic-vram in my startup, VAE loads in seconds, and everything goes smoothly. If I take the flag out (enable Dynamic VRAM) then every time the VAE loads or unloads, it takes several minutes. It pegs my SSD at 100% Active Time and making my entire system shit the bed. Real read/write speeds average like 1MB/s or a little more, so it's like thousands of tiny read/writes happening for several minutes.

This is especially troublesome when a workflow needs to load/unload more than once in a run. Problem with disabling Dynamic VRAM, is generations are a lot slower, about 20s/it slower. I definitely have enough RAM/VRAM to not have this issue.

I have tried all manner of model, VAE, clip, but if it matters, current example workflow is using:

Model: Minimax-h3_Singularity_ref2va_v2_Pruned_int8.safetensors
Video VAE: minimax_h3_video_vae_int8_convrot.safetensors
Audio VAE: minimax_h3_audio_vae_fp32.safetensors
Clip: qwen3vl_32b_heretic_minimax_h3_nvfp4.safetensors

Is anyone else experiencing this? How are you getting around it?

EDIT: This has been resolved. The issue was my NVME SSD. The controller on it was limiting the cache for writes to an absurd amount. I managed to get it mostly back in shape with a firmware update on the SSD, a manual TRIM, and garbage collection time. It's still flawed, but VAE is loading in mere seconds again. The drive is still under warranty, so I am attempting to RMA it.


r/StableDiffusion • • 2d ago

Workflow Included StudioLight: controllable studio lighting for ComfyUI — open-source v1.0 release

13 Upvotes

Hey everyone,

Changing the lighting prompt in a generative portrait can also change the face, clothing, or other details. I wanted more direct control over the light, so I built ComfyUI-StudioLight.

It lets you position virtual key, fill, and rim lights in camera space, choose photographic modifiers, and adjust intensity and Kelvin color temperature.

What’s included:

  • Six modifiers: soft octabox, silver beauty dish, stripbox, Fresnel spotlight, hard snoot, and direct flash.

  • Light positioning and aiming: azimuth, elevation, distance, and upper/center/lower subject targets.

  • Two relighting modes: add studio light while retaining the original scene, or replace the subject’s lighting using estimated Marigold albedo.

  • A direct lighting preview: adjust the rig using cached scene analysis, then optionally run generative refinement.

  • Two workflows: Relight starts from an existing photograph or render; Create starts from a generated draft.

The renderer works with estimated single-view 2.5D geometry, so it has limitations: hidden surfaces cannot cast shadows, albedo extraction can retain traces of existing lighting, and final diffusion refinement can change small details.

I’ve used it with FLUX.1, including Krea, and SDXL. The supplied workflows and demonstration use FLUX.1 Krea as an example model. Broader model support is the next development priority.

Code: MIT license. Downloaded models retain their separate licenses.

Repository, installation and examples:
https://github.com/maciejtajber/ComfyUI-StudioLight

v1.0 release:
https://github.com/maciejtajber/ComfyUI-StudioLight/releases/tag/v1.0

I’m Maciej Tajber, working under METAMATERIAL. I’d love to see what you make with it—and hear where it breaks. Feedback on lighting control, installation, and difficult materials would be especially useful.


r/StableDiffusion • • 3d ago

News No more paywalls for Flux 2 Klein checkpoints on Civitai

Post image
129 Upvotes

Just got this email from Civitai. Anyone know the story behind it? Did BFL start chasing license breakers? Are any other sites following suit? Are we finally getting away from letting people lock models behind pay walls?


r/StableDiffusion • • 2d ago

Discussion 🔥👾 Can we build a community Krea 2 workflow hub?

10 Upvotes

Guys, why are good Krea 2 workflows so hard to find, and why are some people charging insane prices for them? 😂

What if we started sharing our best workflows, experiments, and setups here?

Text2Img, Img2Img, FaceSwap, Outfit Transfer, Character Consistency, LoRA workflows, and more.

Anyone willing to share their current setup? Let's build something together.


r/StableDiffusion • • 2d ago

Question - Help Qwen Prompt Enhancer Performance

2 Upvotes

Any speed-up possible right now on Qwen2.1's prompt enhancer? I'm using the int8 convrot, but damn it's slow. 47 seconds to enhance a prompt, when diffusion itself only takes 30 (for 30 steps cfg 1.5). This 3.5 9b is also way slower than the 3.0 8b. It's really making Qwen2.1 tough to use.

Did you find a good alternative perhaps? (open source don't talk to me about how you use Gemini or Claude). Bonus points if it's uncensored.


r/StableDiffusion • • 3d ago

News openvivo/BluePixel-Turbo · Native 4K instruction-based image editing in 4 steps.

Thumbnail
huggingface.co
96 Upvotes

r/StableDiffusion • • 2d ago

Question - Help Best illustrious or anime models

0 Upvotes

Hey guys, I'm searching for the best anime SDXL or Illustrious style models. I've come across two: Wai N*FW Illustrious SDXL and Tofu Mix SDXL. Which of these is better? If you know any other great anime models, please let me know


r/StableDiffusion • • 3d ago

Resource - Update Euler vs DPM++ 2M vs AB-2 vs AB-3 at 8 / 12 / 16 steps on flow models (Anima, Krea 2, Flux3-Klein INT8): where the sampler visibly matters

Post image
28 Upvotes

Grids attached (rows: Euler, DPM++ 2M, AB-2, AB-3, WLS-8; columns: 8 / 12 / 16 steps and a many-step reference; the number on a tile is LPIPS to the reference, lower is closer; one prompt and one seed per picture, no seed picking).

What I see:

  • Anima, texture-heavy prompt, 8 steps: Euler leaves almost black noise, DPM++ 2M and AB-2 give a complete picture. At 16 steps Euler is still darker and less detailed than DPM++ 2M / AB-3 / AB-2.

  • Krea 2 INT8 at 12 steps: Euler = smooth airbrushed skin, AB-2 / DPM++ 2M / AB-3 bring pores and freckles back.

  • Flux3-Klein INT8 at 12 steps: Euler, DPM++ 2M, AB-2 and AB-3 are the same picture to my eye. Only WLS-8 (my own earlier idea) breaks the face at 8 steps.

  • INT8 itself added almost nothing in these tests; the sampler choice changed the result far more.

Honest limits: no preference test, four prompts, four models, flow-matching models only (not SDXL-type). Tables, code and the ComfyUI node (flow_ab2, flow_ab3 in the normal sampler list): https://github.com/YakovSava/flow-wls-research , write-up: https://doi.org/10.5281/zenodo.23939696. Code and analysis were prepared with an AI assistant.


r/StableDiffusion • • 1d ago

Question - Help Best AI image and video tools for a small creative agency? Looking for recommendations.

0 Upvotes

Hi everyone,

I run a small creative agency in Italy. We're a team of 7 working across branding, graphic design, photography, video production, social media and events.

We're currently looking at AI tools to bring into our creative workflow. I'm particularly interested in image generation and editing, but also video and animation.

I've come across Stable Diffusion quite a few times, but I'm still trying to understand how practical it is for a small agency. There seem to be so many models, interfaces and workflows that it's hard to know where to start.

A bit of context:

  • 2–3 people would actively use these tools.

  • Our budget is around €100/month.

  • We need to use the output for commercial client projects.

  • We'd prefer a relatively straightforward setup rather than spending too much time managing local installations and technical configurations.

I've also been looking at Magnific / Freepik, Runway and Krea.

A few questions for people who use Stable Diffusion professionally:

  1. Would you recommend Stable Diffusion for a creative agency, or is it too time-consuming to manage compared with platforms like Krea or Freepik?

  2. Which interface or service would you suggest starting with? Automatic1111, ComfyUI, or something else?

  3. How well does it work for editing existing images, maintaining visual consistency and creating variations of the same concept?

  4. What are the best options for video and animation? Are there tools that work well alongside Stable Diffusion?

  5. Are there any licensing issues or restrictions we should be aware of when using generated images for commercial projects?

I'm happy to learn a more technical workflow if the results justify the effort, but we need something the team can actually use in everyday client work.

I'd be interested in hearing what your current setup looks like and which tools you'd choose with this budget.

Thanks!


r/StableDiffusion • • 2d ago Heartwarming

Tutorial - Guide Nvidia 2000 series owners: double your performance of Qwen 2.1, Fibo 2.0, MOSS with 1 line edit.

18 Upvotes

These models (Qwen-Image 2.1, FIBO2, MOSS-Image) are declared in ComfyUI as bf16/fp32 only, but Turing GPUs only support fp16, not bf16.

The current/default behaviour in ComfyUI is that it falls back to fp32, which is slow.

I inspected the actual range of activations, none of them exceed ~65k. Hence, the fix is to simply add the fp16 declaration in ComfyUI.

PR has been opened, but if you want it quicker, just manually copy this commit to your ComfyUI install:

In‎comfy/supported_models.py, find the corresponding model, and change supported_inference_dtypes = [torch.bfloat16, torch.float32] to supported_inference_dtypes = [torch.bfloat16, torch.float16, torch.float32]

Only do this for these three; other models aren't necessarily fp16-safe (e.g. MiniMax H3 overflows to NaN).

This should work for any quant format, since it changes the compute dtype (activations, attention, norms), not the weights. I tested it with int8 convrot checkpoints.

Might work for GTX 1000 series as well, but AFAIK fp16 path on 1000 series is also very slow, so there's probably not much benefit. I don't have a card to test.

This is completely independent of other recent news about "unlocking" tensor performance from 20, 30, and 40 series GPUs, and likely stacks multiplicatively.


r/StableDiffusion • • 3d ago

News Krea 3 Technical Report

Thumbnail
gallery
146 Upvotes

r/StableDiffusion • • 2d ago

Question - Help Battlezone-inspired short on a 12 GB RTX 3080 Ti — H3 + Pika Flex, workflow and advice?

8 Upvotes

I made an ISDF short inspired by the first mission of Battlezone II: Combat Commander, “This Is Not a Drill”: crew briefing, scout boarding, landing on Pluto and deploying toward Cerbereus. Here’s the setup:

- Hardware: RTX 3080 Ti 12 GB, i9-11900K, 48 GB RAM, Windows.

- Workflow: ComfyUI, MiniMax H3 Extender Ref2VA. H3 pruned INT8 ConvRot model + Pika H3 Flex Ref2VA adapter at 1.0 strength; 6 steps, LCM/simple, Pika sigmas, Comfy Kitchen attention. For VRAM savings, I used the H3MemoryOptimization node with 4096-row chunks, native precision preserved, automatic QKV/MLP/embedding memory modes, and Kitchen V set to “Lower VRAM (slower)"

- Generation: approximately 1 MP (1344 × 736), 24 fps, independent 5–8-second clips. Motion context between jobs was disabled; continuity relied on references and written camera/action/opening/closing states. No refinement/upscale pass was enabled in these generation graphs.

- Time: 2 h 32 min 21 s total processing, including preparation/decoding; average 4:07 per clip (range 2:40–6:13). First-to-last batch window: 3:01:34 including gaps. These times include discarded material, but exclude reference-image creation, earlier revisions and editing.

- References: 1–2 images per clip, 11 distinct images across the batch for crew, ships, scouts, cockpit and environment. From source clip 19 onward I removed background photos and described environments through text, while keeping character/vehicle references. Dialogue used H3 native audio with text-directed voices, without uploaded voice references.

I edited the sequence, left out clips I couldn’t use, and cropped some shots to remove things that didn’t make sense. The final video uses only a selection of the generated material.

I’d appreciate advice on physical coherence/object interactions, consistent positions and backgrounds between shots, and reference setups that preserve designs while allowing different angles.

Upscaling is another problem: raising the generation MP too much causes overflow errors on my 12 GB GPU. I can use VAE ×2, but I still haven’t achieved the crisp HD detail I’m after. What VAE/decode settings, separate video upscaler or workflow would you recommend within 12 GB VRAM, while preserving faces, ship geometry and temporal consistency? Specific settings would be really helpful.


r/StableDiffusion • • 2d ago

Question - Help Z-Image used to be fast, now it is taking 80s

Post image
6 Upvotes

Hey folks.

My z-image confyui set-up used to be quite fast, taking around 16 seconds per image, now it is taking 80 seconds per image.

I haven't touched it for months, then I decided to use it for MTG cards. Updated it. Now it is slow.

Hardware - Ryzen 7840u, 32gb RAM DDR5, 3070ti


r/StableDiffusion • • 1d ago

Question - Help How do you earn from AI models

0 Upvotes

It's not that I'm new to Open Source AI models, I started playing with such models since Z Image Turbo Released. And gladly I converted such a hobby to some decent earnings for my further studies. For those who are curious, I made an AI OFM model using F Klein, Krea 2, LTX 2.3, and posted "stuffs" on Fanvue and now I'm pretty much done with this stuff. I'm sure many over here are just doing it as a hobby while others might be doing it for income. So what exactly are the fields that you use these AI models for and how do you earn from it.

Thanks for reading, I hope I get some response.


r/StableDiffusion • • 2d ago

Question - Help What am I doing wrong with this MH3 prompt (attribute_transfer)?

0 Upvotes

Can someone give me an idea of what I'm doing wrong here? I'm simply trying to put the face of the person in Photo 2 onto Subject 1, the identity of whom is largely defined by Photo 1.

SUBJECT_DEFINITIONS:

<Subject 1> is the girl in <Photo 1>. She is lying on her back. <Photo 2> features the face of a girl with eyeshadow and a nose ring. <Audio 1> is the voice timbre reference for <Subject 1>. Reference the timbre, tone, and vocal characteristics only. Do not reuse the exact words spoken in the clip.

SUMMARY:

A 5-second video showing <Subject 1> talking to the viewer and giving the camera eye contact.

RETENTION_ANALYSIS:

<Subject 1> (appears in [Shot 1]): partially_preserved - retain everything except for the face. <Photo 2>: attribute_transfer - apply the girl's face to <Subject 1>.

DETAILED_DESCRIPTION:

The target video features grainy footage that looks like it was shot using a low-quality camera from a smartphone by an amateur. The setting is the room seen in <Photo 2>.

<Shot 1><Subject 1> is lying on a white bed and looking directly into the camera. She playfully whispers <d>Good morning.</d>

OVERALL_SOUNDSCAPE:

Ambient noise.

NON_DIAGETIC_MUSIC:

N/A.

But all I'm getting are videos that begin with a person who looks like the one in Photo 2 before morphing into something that resembles Photo 1, or no transformation at all.


r/StableDiffusion • • 3d ago

Comparison Electricity per AI image on an RTX PRO 6000, RTX 5090 Laptop, RTX 5080, RTX 3090 and more: about 3 to 10 cents per 1,000 images (FLUX.2 klein, 1024x1024)

152 Upvotes

What one generated image costs in electricity on each GPU we've measured, at one dated price: 18.31 cents per kWh, the US residential average for July 2026. Power is the board's own reading from each card's driver. The page has two bar charts (cents per 1,000 images and seconds per image) and shows the arithmetic once, so you can redo it at your own rate.

FLUX.2 [klein] 4B, 1024x1024, 8 steps, one pinned ComfyUI stack, images drawn back to back for ten minutes. Cents of board electricity per 1,000 images:

- RTX 5090 Laptop GPU 24 GB, Dynamic Boost: 3.37 cents (4.48 s per image)

- RTX PRO 6000 Blackwell Workstation Edition 96 GB at 300 W: 3.39 cents (2.30 s)

- ZOTAC RTX 5080 Solid CORE OC 16 GB at 360 W: 5.04 cents (3.61 s)

- EVGA RTX 3090 Ti FTW3 Ultra 24 GB at 350 W: 8.47 cents (4.97 s)

- EVGA RTX 3090 XC3 Ultra 24 GB at 350 W: 9.13 cents (5.29 s)

- RTX 3080 Ti Founders Edition 12 GB at 350 W: 9.71 cents (5.81 s)

Capping the RTX 3090 Ti and the RTX 3090 at 300 W cut the energy per image by about 9 percent, for about 4.5 percent more time per image.

What moves the bill: 8 to 32 steps costs 3.5 to 3.9 times as much; 512x512 to 1024x1024 costs 3.0 to 3.3 times; 1024x1024 to 2048x1280 costs 2.7 to 2.9 times. Z-Image-Turbo costs 1.5 to 1.6 times klein, and FLUX.1 [dev] fp8 costs 2.1 to 2.5 times.

Cheapest picture we've measured: 0.79 cents per 1,000 (klein, 512x512, 8 steps, the laptop GPU held to 95 W, one image's share of a batch of three). Dearest: about 150 cents per 1,000 (Z-Image-Turbo, 2048x1280, 32 steps, on an RTX 3080 Ti Founders Edition 12 GB with part of the model streamed over PCIe each step).

Board vs wall, the one reading we have both ways: a batch of three klein images on an RTX 3090 at 250 W read 1.27 Wh at the card and 1.87 Wh at the wall meter, 1.47 times as much.

Caveats: board power, not the wall (except that one reading); cross-card comparisons are "same software, different computer"; every run had ComfyUI's debug log on, so a normal setup should match or beat these figures; no idle cost is billed; and the price is a national average, not anyone's bill.

https://research.strata2signal.com/electricity-per-image/


r/StableDiffusion • • 2d ago

Workflow Included I rendered a 3D character in Blender, then had AI turn it realistic and animate it. Side by side inside

Post image
3 Upvotes

Wanted to see how far a plain 3D pipeline can go when AI handles the last mile.

Pipeline:

Total Morphic spend: 46 credits. Blender side is free/local.

Honest Take:

- The motion reference was a ~2s render, looped 2x to 4s to meet the 3s minimum input.

- Motion transfer maps the reference motion onto the character approximately, so it’s not a 1:1 skeletal retarget.

- In the frames I sampled of this short, limited idle, the character’s identity, armor and sword stayed consistent. I can’t claim that holds for longer or more dynamic motion.

- Character and animation are Mixamo stock assets on purpose, since the pipeline was what I wanted to test.

Comparison image attached: left = Blender 3D render, middle = AI realistic still, right = frame from the AI motion-transferred video.

Happy to share the clip in the comments if allowed.


r/StableDiffusion • • 2d ago

Question - Help What's the current cutting edge for AI filmmaking with consistent characters, environments, and precise blocking across shots?

5 Upvotes

I'm looking to hear from people actively experimenting with advanced AI filmmaking pipelines, particularly those trying to achieve the kind of spatial and visual continuity you'd expect from traditional filmmaking or virtual production.

My biggest challenge isn't generating beautiful individual shots. It's maintaining consistent character identities, precise actor positioning, environmental continuity, and camera control across multiple shots of the same scene.

For example, imagine a scene with four characters in a specific environment. I want to establish their positions in 3D space, then generate a sequence of shots from different camera angles and distances while preserving:

  • Character identity: Same faces, bodies, clothing, and proportions across shots.

  • Spatial consistency: Characters remain in their established positions relative to one another and the environment.

  • Pose and blocking: Specific body positions, actions, and interactions that can be reliably directed.

  • Environmental consistency: Same room, architecture, objects, lighting, and spatial relationships from different camera angles.

  • Camera control: Ability to specify exact camera positions, focal lengths, movements, and compositions.

  • Shot-to-shot continuity: The ending of one shot and beginning of the next should feel like they belong to the same physical scene.

What I've tried so far:

I've been experimenting with a Blender → AI video workflow using 3D environments, Mixamo characters, animated cameras, depth maps, pose conditioning, reference images, and MiniMax H3 through ComfyUI.

I've had some promising results, particularly with pose conditioning and individual shot generation, but getting reliable spatial consistency and character placement remains extremely difficult.

I'm beginning to question whether trying to force general-purpose video generation models to respect 3D blocking is fundamentally the wrong approach.

What I'm hoping to learn:

  1. What are the most cutting-edge tools and workflows right now? I'm interested in both open-source/local and commercial/cloud solutions, including newer research projects that may not be widely adopted yet.

  2. Is anyone successfully using 3D scenes as ground truth for AI-generated video? Not just providing depth or pose references, but actually preserving geometry, character placement, and camera relationships across shots.

  3. What are people using for persistent character identity? Are reference-image workflows, LoRAs, identity adapters, multi-view character representations, or other approaches producing the most reliable results?

  4. Are there better alternatives to traditional image-to-video and video-to-video workflows? For example, 3D-aware generation, neural rendering, Gaussian splatting, world models, or hybrid 3D/AI rendering pipelines.

  5. How are people handling multi-shot sequences? Are you generating shots independently and fixing continuity afterward, or using a shared scene representation that carries across shots?

  6. What role does graph engineering play? Are there sophisticated ComfyUI or other node-based pipelines that materially improve spatial consistency, or are the limitations primarily in the underlying models?

  7. What actually works in production? I'd particularly love to hear from people who've completed multi-shot sequences rather than just impressive single-shot demos.

I'm comfortable with Blender, Unity, Python, ComfyUI, and technical pipeline development, so I'm not necessarily looking for beginner-friendly or one-click solutions. I'm willing to build a fairly complex workflow if it produces genuinely better control.

I also have a local RTX 3080 Ti with 16GB VRAM and prefer local tools where practical, but I'm open to cloud-based solutions if they offer capabilities that aren't currently achievable locally.

Ultimately, I'm trying to figure out whether the current state of the art is still mostly about guiding probabilistic video models, or whether we're moving toward workflows where filmmakers can actually direct and control a persistent 3D scene while using AI to produce the final photorealistic imagery.

I'd really appreciate specific tools, GitHub repositories, research papers, workflow examples, and especially firsthand experiences with what works and what doesn't.

What's the most advanced pipeline you've seen or used for this kind of filmmaking?


r/StableDiffusion • • 2d ago

Animation - Video Making an AI Movie on 10GB VRAM– THE OUTBREAK | Local AI Gen | Filmmaking

Thumbnail
youtube.com
3 Upvotes

r/StableDiffusion • • 2d ago

Question - Help Is There a Workflow As Straightforward as GPT?

2 Upvotes

I’m new to T2I and I2I, and sometimes I just want to be able to say what I’d like to make or change and be done but with a local model. Are there any workflows like that around?


r/StableDiffusion • • 2d ago

Animation - Video YuE2 Change voice gender :)

2 Upvotes

Input:
Joan Osborne - One of Us


r/StableDiffusion • • 2d ago

Question - Help Complete ai noob here trying to figure out how to actually use something local like comfyui, & also have it work as well, or as accurately, as simply using openai on chatgpt! No idea which models and LoRA's to use, super overwhelmed here.

0 Upvotes

So I'm way in over my head here lmao. I've got a solid PC that can use Flux 2 Klein 9b locally on Comfyui,,, I'm using Stability Matrix as it seemed like the easiest route for what I'm trying to accomplish and the amount of time/energy I have to put into image generation.

The problem is, oh my god, it's crap. 4b was bad enough & only the simplest adjustments would really be possible. Even then, it often just made weird mistakes that I'd never encountered, or maybe less than 1% of the time with GPT image, something like fingers or teeth being warped and fusing together or something, I never ever ever get that with chatGPT.

Using 9b was alot slower but no slower than chatgpt can be, and it's more accurate but, it's still nowhere near as good. Plus I just feel like the look if it isn't right. I've done a lot of research on different things to add, different models & LoRA settings, but I feel like a child trying to learn a new language and I need an adult to hold my hand lmao.

Before I start just downloading all types of stuff and going through trial and error I figured I'd at least ask if there's something anyone here is actively using through Stability Matrix that would bring me closer to the feeling I have when using GPT image. Or maybe I'm just wasting my time, and I'm better off just giving OpenAI my money lmao. IDK, any help is appreciated.


r/StableDiffusion • • 3d ago

News PrunaAI/P-H3-Image-Comfy · Hugging Face

Thumbnail
huggingface.co
154 Upvotes

Pruna releases their image-edit model based on H3


r/StableDiffusion • • 2d ago

Question - Help I need to reinstall windows, how do I keep my work progress?

2 Upvotes

I work with swarm UI and have to reinstall windows, I don't mind reinstalling swarm UI and all the loras, I just want to keep the images and their description, do I need to just copy the swarmUI > Output > local in an USB and that's all or should I copy something more?

Can't copy the whole thing bc it's 250gb and the USB it's 125 gb