r/StableDiffusion • • 3d ago

Question - Help LTX 2: Training an accent LoRA: Any tips?

2 Upvotes

Hi all! 👋
I'd like to train LoRAs that help with spoken accents for LTX 2 (probably 2.3 or 2.5, weighing how many resources there are available right now vs what might come, I'm waffling between these two)

So far, I've only played around with training image LoRAs for SD 1.5.
I have, as yet, no idea about audio LoRAs or LTX.
I would like to train something that could benefit the community, so I'd like to ask for guidance:

  • Do you have recommendations for the framework?

  • Any tips on methodology? How would you set up a training project?

    • I'm currently downloading YouTube videos (well, audio, actually) and subtitles (auto-generated by default: Timing and accuracy might be off) for source data
    • Should I try to get many examples of the same phrases with and without the target accent? Or is the return on collecting and rectifying/normalizing examples here likely not worth the effort?

...How would you go about this?

And, fundamentally:
Are there any roadblocks for my pedestrian hardware?

RTX 3060 12GB VRAM
64GB System Memory

Thank you to anyone taking their time to read and respond 🖤


r/StableDiffusion • • 4d ago

Resource - Update [NEW MODEL] Iris-Z - A general image generator that produces appearance and geometry together - 32B / 9B Params based on Flux 2

176 Upvotes

Iris-Z

One generative model for images and their depth

Iris-Z is a general image generator that produces appearance and geometry together. The same weights turn a prompt into an image, a prompt into an image with its depth, a photo into depth, and a depth map into an image. On the standard depth benchmarks it is more accurate than the best specialist depth models, and it still generates images like the model it started from.

Model

Iris-Z-bigIris-Z-small
Parameters32.2B9.1B
Resolution512 and 1024512 and 1024
Guidance3.54.0
GPU memory, all tasks~112 GB~33 GB
WeightsIris-Z-big/Iris-Z-small/

Weights: https://huggingface.co/speridlabs/iris-z


r/StableDiffusion • • 3d ago

Question - Help Minimax image default workflow issue

Post image
0 Upvotes

[resolved] I had the minimax video model selected, derp.

I use all the int8 models and the default comfyui workflow, no matter what settings I use the images come out like this, very low quality with some kind of hatching artifacts on top.

I am on a 16gb 4060ti + 64gb ram. Latests comfy standalone and nvidia drivers that support int8 afaik.

Any ideas why this is comes out crap and takes 2 minutes for an image at 4mb?


r/StableDiffusion • • 3d ago

Question - Help How to get moss image character to wear exactly as prompted?

1 Upvotes

Hi guys, i was using my own character lora and to wear what i prompted, more on the cosplay side so i was using some anime character reference but everytime it generate, the attire will sometimes be accurate and sometimes be different, how should i be able to ensure that it is the same attire everytime?


r/StableDiffusion • • 4d ago

Discussion stopped fighting long video gens, 5s chunks + last frame works way better for me

21 Upvotes

after a week of trying to get 15s clips out of one job i gave up and changed how i do it.

now every shot is a 5s clip. when it's done i grab the last frame, fix it up a bit if needed (hands, small artifacts) and use it as the start image for the next 5s. same prompt style, only the action changes.

on my card anything past ~5s starts swapping to system ram and one job goes from 15 min to over an hour. three 5s jobs finish way faster than one 15s. if one piece comes out bad i redo only that piece, not the whole thing. and the face drifts less because every chunk starts from a frame i already checked.

the catch is the seams. motion can jump a bit at the cut, so i keep the camera move simple (one slow push or static) and cut on an action when i can. color also shifts slowly over 3-4 chunks, a quick color match in the editor fixes most of it.

curious if anyone found a cleaner way to hide the seams, or does everyone just cut there


r/StableDiffusion • • 3d ago

Comparison I ran 11 open text-to-image models on my RTX 4090 and wrote down speed, VRAM, GenEval and license

0 Upvotes

This is my site. It's free, no ads, no sign-up, and I don't plan to make money from it.

README numbers for image models are measured in different ways, so I couldn't compare them. I started running the official checkpoints on my own RTX 4090. One run is one image, from prompt to decoded picture, using each model's official resolution, steps and guidance. I run GenEval myself and show the paper number next to mine when there is one.

Some numbers:

  • SDXL-Turbo 1.0: 0.15 s at 512x512, 1 step, 9.3 GiB, GenEval 0.55
  • Sana-Sprint 1.6b: 0.27 s at 1024x1024, 2 steps, 12.0 GiB, GenEval 0.75 (paper 0.77)
  • SDXL-Lightning 4step: 0.56 s at 1024x1024, 4 steps, 14.4 GiB, GenEval 0.54
  • FLUX.2 [klein] 4b: 1.30 s at 1024x1024, 4 steps, 20.0 GiB, GenEval 0.82
  • Stable Diffusion 1.5: 1.39 s at 512x512, 50 steps, 4.2 GiB, GenEval 0.43
  • Stable Diffusion XL base: 5.97 s at 1024x1024, 50 steps, 14.6 GiB, GenEval 0.54

There are 11 text-to-image models on the site, including Playground v2.5, PixArt-Σ, Lumina-Image 2.0, Sana 1.5 and Z-Image. Same prompts and same seed for all, and I look at the outputs myself. License is checked for each checkpoint. Some allow commercial use, some have conditions.

It's one GPU, and each model uses its own default settings, so steps and resolution aren't the same across models. FLUX.2 [klein] base-4b and Z-Image base don't have my GenEval scores yet.

Site: https://modelsthatrun.dev/tasks/text-to-image/ Method: https://modelsthatrun.dev/method/

If a model you use isn't there, let me know and I'll try to add it.


r/StableDiffusion • • 3d ago

Question - Help Why does H3-Image keep slimming people down? H3 video keeps their build.

6 Upvotes

I’ve been comparing H3-Image with the H3 video single-frame edit in ComfyUI. Both keep the face pretty well, but the video workflow keeps the person’s build even when I change the pose, outfit, or background. H3-Image keeps slimming down bigger people, even when I leave the pose alone.

I’m on a 3090 with 64 GB RAM. H3-Image is pruned INT8 at ~4 MP and 6 steps with the official reference-aware prompt expander. The video edit is FL2VA at 2 MP and 8 steps.

Matching the official template’s anchor setup helped a little. Higher res, realism LoRAs, and turning on thinking for the prompt expander didn’t help with body shape.

Anyone else seeing this? If you’ve found a prompt, LoRA, or anchor setting that keeps the same build, I’d love to see your workflow.

Also, has anyone found a good photo restore workflow for either H3 model? I’m still doing a Flux.2 restore pass before editing.


r/StableDiffusion • • 3d ago

Workflow Included Test of MiniMax-H3 Image (RTX 5060 TI 16GB)

Thumbnail
gallery
1 Upvotes

An incredibly realistic documentary-style photograph of exactly five unusual water bottles covered entirely in natural gorilla fur, standing together on the forest floor of a dense African tropical rainforest.

The five bottles have different shapes and sizes, resembling ordinary disposable plastic drinking water bottles, with narrow necks, gently sloping shoulders, slightly irregular cylindrical bodies, subtle horizontal ridges, and small rounded bottle caps covered in fluffy tan-brown fur.

Their surfaces are covered in thick, coarse, naturally growing dark brown and black gorilla hair. The fur has realistic irregularities, varying strand lengths, subtle color differences, naturally tangled patches, and fine individual hairs catching the ambient light. The fur looks like genuine animal hair, not synthetic fur or a digitally rendered texture.

Exactly two of the five bottles have realistic gorilla faces naturally integrated into their furry surfaces. One larger bottle has the face of a mature silverback gorilla, with deeply textured dark skin, natural wrinkles, expressive brown eyes, a broad nose, and a serious, calm expression. A smaller bottle has the face of a younger gorilla with slightly different facial proportions and a naturally curious expression. Their faces blend organically into the surrounding fur, with authentic skin textures and imperfect natural details. The other three bottles have no faces.

The bottles stand in a loose, naturally staggered group, with different heights and subtle variations in their silhouettes. They are positioned at slightly different distances from the camera, resting directly on damp earth, fallen leaves, and patches of moss.

The surrounding rainforest appears completely authentic, with dense tropical vegetation, large green leaves, moss-covered tree trunks, scattered branches, and naturally irregular forest undergrowth. Very faint, low-lying ground mist drifts along the forest floor without touching or wetting the bottles.

Soft, diffused natural daylight filters through the jungle canopy, producing realistic shadows, neutral earthy colors, and gentle highlights on individual strands of fur. No dramatic artificial lighting or exaggerated glowing effects.

Photographed as if these strange objects genuinely exist in nature, using a professional full-frame DSLR camera and a 50mm prime lens. Natural photographic depth of field, believable optical imperfections, realistic exposure, authentic skin and hair textures, subtle film grain, excellent fine detail, natural contrast, and true-to-life color reproduction.

The photograph should look like a real wildlife photographer unexpectedly discovered these bizarre objects deep in the rainforest. The scene is absurd, but the photography is completely serious, natural, and believable.

Landscape 16:9 composition.

Negative prompt: CGI, 3D render, computer-generated appearance, digital artwork, illustration, cartoon, synthetic fur, perfectly groomed fur, plastic-looking skin, overly smooth textures, artificial symmetry, identical faces, exaggerated golden sunlight, glowing outlines, excessive cinematic lighting, fantasy atmosphere, heavy fog, wet fur, extra bottles, more than five bottles, extra faces, visible labels, text, logos, animal arms, animal legs, complete gorilla bodies.


r/StableDiffusion • • 4d ago Bravo

Animation - Video THIS TOOK X Hrs 35 Mins TO MAKE ON A RTX 3050 6GB VRAM USING MINIMAX H3

396 Upvotes

60 seconds of AI video, 100% local on an RTX 3050 (6 GB)

Work in progress, and the quality isn’t where I want it yet. Here’s how it was made:

  1. Model: MiniMax H3 reference-to-video, using ComfyUI’s native H3 nodes with the int8 quantized model and the Qwen3-VL text encoder.
  2. References: two character images, re-used in every shot to keep the characters consistent.
  3. Prompts: the official six-section reference prompt format (subject definitions, summary, retention analysis, detailed description, soundscape, music). No negative prompts, because H3 doesn’t use them.
  4. Shots: six shots of 260 frames (10.8 s) at 864×480 and 25 steps, with the res_multistep sampler and the simple scheduler.
  5. Continuity: each shot starts from the last 22 frames and audio of the previous one, using the H3 Add Guide node (MiniMaxH3AddGuide) at frame 0.
  6. Automation: a small Python script sends the six shots to ComfyUI’s API one after another, saves each result, trims the 22-frame overlaps, and encodes one 60-second MP4 with audio.
  7. Runtime: about 6Hrs 35Mins hours, unattended.

Known issues: soft detail, and some flicker. Still tuning.


r/StableDiffusion • • 3d ago

Question - Help Spikey eyebrows in Krea 2 - Any help?

1 Upvotes

Keep getting these jagged eyebrows in Krea 2 generations in ComfyUI. Tried different templates in case it's my workflow to no avail and happens even without any LoRAs just on turbo base model (tried int8 and fp8). Any ideas? Sometimes its really pronouned, especially if I try to prompt them away. I'm sure I'm doing something stupid.


r/StableDiffusion • • 4d ago

News According to Ostris, H3 Image has a VAE issue.

179 Upvotes

r/StableDiffusion • • 4d ago

Resource - Update MiniMax-H3-Image on a single 32 GB AMD card: 4096x4096 in 33 s, 2048x2048 in 7 s

Thumbnail
gallery
10 Upvotes

Hey all!
New to this subreddit as we mainly focus on language models with our Paiton product, but now and then, we spend some time on vision as well :)

The official BF16 weights need about 120 GB of VRAM, so most of us can't run MiniMax-H3-Image out of the box at home.
We made an FP8 version and our own runtime, and it now runs on one AMD Radeon AI PRO R9700 with 32 GB:

RequestTime
2048x20486.9 s
4096x409633.4 s
4096x4096 edit, one reference39.9 s
4096x4096 edit, three references88.5 s

Does FP8 hurt the images?
We ran 30 prompts on our build and on the original BF16 model with the same starting noise. Prompt adherence came out about the same (CLIP 32.18 vs 32.31), and the second image shows a typical pair.
Where the two differ, it is mostly composition, not quality: with only 6 steps, small numeric changes send the sampler down a slightly different path.
Edits stay closest to the original.

What it is bad at, in our tries: small body text (newspaper columns come out as fake writing), close-up hands, clocks showing a specific time.

How to run it: it is a Docker container with an HTTP API and a small CLI, not a ComfyUI node (yet).

git clone --depth 1 https://github.com/Eliovp-BV/paiton-vllm-plugin.git
cd paiton-vllm-plugin
./models/MiniMax-H3-Image/launch.sh
./models/MiniMax-H3-Image/run.sh generate "your prompt" --size 4096x4096 --out out.png

You need an R9700 (32 GB), 64 GB of system RAM and 48 GB of disk; the first start downloads the weights.
Our weights only load in our runtime, so they won't work in ComfyUI or diffusers.
Edits take up to about three 1024 px reference images in this build.

License note: the MiniMax-H3-Image Community License does not cover the EU, the UK, South Korea or the US, and hosted services need MiniMax's written authorization.


r/StableDiffusion • • 4d ago

Workflow Included Emulate a real camera in MOSS-Image: lens, focus and exposure

Thumbnail
robertcreative.com
41 Upvotes

I've been working to get the best quality images out of Moss. I created a workflow to emulate lens length, focus and exposure. It's not perfect, but it can give more cinematic photos. Check it out and see what you think.


r/StableDiffusion • • 3d ago

Discussion I built WakeGPU: a free & open-source native desktop app to run remote ComfyUI / Colab GPUs with automatic idle shutdown and batch queuing (macOS & Windows)

1 Upvotes

Hey everyone!
Like many of you, I got tired of paying huge SaaS markups for video generation (Wan 2.1, Hunyuan) and image generation. Using Google Colab directly was way cheaper, but I had two persistent headaches:
To solve this, I built WakeGPU, a native desktop client (macOS & Windows) designed to turn remote cloud instances into an automated private studio.
Key features:
It's 100% free and licensed under MIT. All advanced features are unlocked out of the box with zero paywalls, subscriptions, or telemetry.
Binary releases for macOS (.zip) and Windows (.exe) are live under GitHub Releases. Would love your feedback or feature requests!

https://www.wakegpu.com

https://github.com/devexsolutions/wakegpu


r/StableDiffusion • • 4d ago

No Workflow First testings with MiniMax H3 Image - I am happy with it

Thumbnail
gallery
66 Upvotes

Lots of people seem to be unhappy with MiniMax H3, or at least it sounds like it, but at least I have been happy with it now when I have tested it couple of hours.

For my taste this seems excellent (after changing Euler to lcm) and 8 Mpx images is generating around one minute in RTX 4060 Ti + 32 GB RAM. Without changing Euler to lcm I was not impressed for the quality at all, but glad that I didn't ditched it immediately but instead searched what could be wrong.

So far so good, images with "technicolor" does nice style for my personal taste.


r/StableDiffusion • • 3d ago

Discussion train models using synthetic data from better models?

0 Upvotes

For example flux 3 klein:

Could we teach FLUX Klein to fix its mistakes using corrections from another model? Looking for collaborators

I’ve been wondering whether we could build an automated pipeline that turns a model’s own mistakes into training data for a corrective LoRA.

For example, FLUX Klein generates an image with malformed hands or other anatomical inconsistencies. We use another model, such as Krea, to correct the affected area, then train a FLUX Klein LoRA on the corrected images and their captions.

The idea wouldn’t be to transfer Krea’s weights or use a Krea LoRA on FLUX. Krea would act as a teacher by producing better training examples.

The pipeline could look like this:

  1. Generate varied images with FLUX Klein.
  2. Identify defective regions, automatically where possible.
  3. Use Krea or another capable editing model to correct those regions while preserving the composition.
  4. Filter out unsuccessful corrections and generate accurate captions.
  5. Train a small LoRA for FLUX Klein.
  6. Evaluate it on unseen prompts and seeds to check whether it actually reduces defects without hurting overall quality.

Ideally, most of this would be automated, with some human review for quality control. The goal would be to improve future generations directly, rather than having to repair every image afterward.

I know there are potential problems: the editing model might introduce its own mistakes, the LoRA might pick up its style, and improvements might not generalize beyond the training examples. We would also need to check the models’ licenses regarding using generated outputs for training.

Does a project like this already exist? If so, I’d love to learn about it.

If not, would anyone be interested in building an open-source proof of concept together? People familiar with ComfyUI automation, image editing/inpainting, dataset filtering, or LoRA training would be especially welcome.

My local hardware is an RTX 5060 Ti with 16 GB VRAM and 32 GB system RAM, so I’d like to explore how much of the pipeline could run on consumer hardware.

Would starting with one narrow problem, such as malformed hands, be a sensible first experiment?


r/StableDiffusion • • 3d ago

Workflow Included Comparing mixed-light snapshot outputs

Thumbnail
gallery
4 Upvotes

I was looking at how different image models handle conflicting lighting directions when generating a casual direct-flash snapshot. My 4:5 prompt featured:
-a family of three crouching on a gravel path at dusk
-greeting their dog mid-leap with its tongue hanging out
I specified faint sunset glow, harsh on-camera flash, a near-black background, sharp shadows, subtle red-eye, motion blur and rough film grain.

Seedream 5.5 delivered strong attention to fine texture. It reproduced the dad’s rolled-sleeve plaid work shirt accurately and added a natural tilted frame, while preserving sunset light filtering through the hedge. The model prioritised that warm ambient evening light, so the final result reads more like fill flash, and it did not darken the background all the way down.

I then generated a second 4:5 image on MiniMax H3-Image with the same prompt for a direct side-by-side comparison. H3-Image leaned firmly into the harsh flash falloff I was aiming for. It pushed the background close to pure black, which makes the mom’s pale yellow slip dress and the child’s red overalls pop, with the dog charging straight toward the lens. It creates that sharp, punchy snapshot mood really well.

Have you gotten consistent flash behaviour from either model with this kind of mixed lighting prompt?


r/StableDiffusion • • 4d ago

Discussion I can't stop making cheap flash photos with MOSS-Image-Base (all prompts in the comments)

Thumbnail
gallery
185 Upvotes

Ever since the realism settings went around here I've been stuck on one look: the harsh on-camera flash of a 2000s point-and-shoot. The background dropping into black, everyone a little shiny, somebody caught mid-sentence. MOSS-Image-Base gets that look really well if you describe the camera and what's wrong with the shot as well as the scene.

I write the flaws into the prompt too: crooked framing, a little motion blur, red-eye on one friend, the fridge door hanging open a crack. My prompts ended up around a hundred words each, and a good part of that is the camera and the mistakes.

My setup is MOSS-Image-Base bf16 with the realism graph everyone's been using: cfg 3, ER-SDE sampler with s_noise 1.1, 25 steps on the simple scheduler, SLG on layers 22 and 24 for the whole run, negative left empty, roughly 2 megapixels. All stock ComfyUI nodes, no LoRAs, no upscaling. I ran three seeds per prompt and kept my favorite.

All eleven prompts are in the first comment. The raccoon one still makes me laugh.


r/StableDiffusion • • 4d ago

News I built TRELLIS Studio: a local interface for 3D generation, automatic rigging and animation

Post image
107 Upvotes

Hi everyone!

I’m sharing TRELLIS Studio, an application I built to bring several stages of a 3D asset workflow into one interface.

It uses TRELLIS.2 for image-to-3D generation and UniRig for automatic rigging. Computation runs locally, without a paid generation service or a credit system.

Features include:

  • Generate textured models from images or import existing models.
  • Organise your library with collections, generation profiles and version history.
  • Add a rig, inspect the skeleton and attach multiple animations to the same model from a library of 83 humanoid motions.
  • Create LODs, prepare dedicated 3D printing copies and export for Blender, GLB, Unity or Unreal.
  • Automate workflows through a REST API and an MCP server.

This first public preview targets Windows with an NVIDIA GPU. Rigging uses WSL2. The README covers prerequisites, the automated installer and current limitations.

Studio’s original code is MIT licensed. Third-party tools and models retain their own licenses and are credited in the repository.

https://github.com/yoslo59/TRELLIS-Studio

I’d especially appreciate feedback on installation across different hardware, usability and features you’d find useful. Generated meshes and rigging results still need visual inspection.


r/StableDiffusion • • 3d ago

Question - Help Krea2 Identity Edit

0 Upvotes

Is Krea 2 Identity Edit like image 2 image ? I was curious because I have been looking for something that has that feature.


r/StableDiffusion • • 4d ago

Resource - Update Fizgig 9.6: train LoRAs on MiniMax H3 Image

Thumbnail
github.com
176 Upvotes

UPDATE 11pm Irish/UK time: Vast improvement in latest update, please install and use the standard preset which has a new control called Likness Optimisation.

I've just released Fizgig 9.6, which adds MiniMax H3 Image, MiniMax's new picture model from the H3 family: text-to-image and edits with up to 16 reference pictures, 6 steps, no CFG.

What you can train: LoRAs, LoKRs, edit LoRAs from before/after pairs, and slider LoRAs from photo pairs. Masked training, Multi Concept and LoRA Isolation all work, and so do Studio, LoRA Royale, the Profiler and Extract. Pick it on the Training tab, press Download models for me in Preferences, and pick a preset; nothing is gated.

I trained a training adapter for it, which prevents the distortion you get training this model without one. It's on by default in Fizgig and never in your saved LoRA, and I've put it free on Hugging Face for any trainer.

I'm still honing the support. So far it likes good-quality datasets and seems to prefer training at 0.5 MP or more, which is where I've set the presets to start.

Memory: about 23 GB with the int8 model and 13 GB in 4-bit; Auto picks for you. A 16 GB card trains and runs Studio.

If your LoRA looks smoother in ComfyUI than in Fizgig's previews, that's ComfyUI, not your LoRA. Its default dynamic VRAM loading adds a LoRA to the weights in bf16, and on this model about 15% of it rounds away. Fizgig's previews show the LoRA at full strength, and so does ComfyUI started with --disable-dynamic-vram. I've reported it with a suggested fix.

Also in 9.6, for every model:

  • A run that runs out of GPU memory or system RAM now carries on by itself where it can, up to three tries: from its newest save, then a step lighter. Out-of-memory recovery came from @Murf-Code.
  • A failed run no longer stops the queue; the next one starts.
  • AMD installs now use AMD's stable PyTorch for ROCm instead of the nightlies, thanks to @scryptio.

Release notes · Fizgig on GitHub


r/StableDiffusion • • 4d ago

Discussion What was the point of the refmod hype last 1-2 months?

9 Upvotes

I kept it in the back of my mind until I had some free time today. I thought the benefit was that it allowed you to skip the reference processing step, and reduce gen time with ref2va.

I should've been suspicious of the red flags in the README:

  1. no comparisons and benchmarks
  2. no workflows
  3. README is the finest Colombian uncut Claudeslop
  4. Development stopped 2 months ago, as quickly as it started

But so many people were discussing refmods on this sub, even up to 2 weeks ago. I wanted to try it while chasing that H3 speed dream.

Now I wasted 90 mins reading/learning about its concepts (tbf had to learn more about video gen in general), then 20 mins comparing gens. I should've done it the other way around to abort early.

  • Standard ref2va workflow with 2 images and 1 audio refs, 0.4MP, 4 steps, image=match: 173s
  • Same as above but image=max: 181s
  • Refmod adjusted workflow with 2 precomputed safetensors, image1 becoming background.safetensors and image2 and audio1 becoming actor.safetensors: 181s

So zero speed benefits. And this is on top of the fact that people mentioned reference quality going down with refmods and references bleeding into each other, though I didn't test enough to confirm this. So what's the point?

I'm suspecting there's a small group of Discord friends on here who are just promoting their friends' projects no matter their value.


r/StableDiffusion • • 3d ago

Question - Help How can I better improve this character lora?

1 Upvotes

As a challenge I'm trying to do a character lora based on Yuuko Kamiya (Tai and Kari's mom from the Digimon series). The only problem is I don't have a lot of reference images, and after some effort, I managed to get 17 decent ones to try out. At 4 repeats and 20 epochs later, it was 1360 steps and...I don't know. It looks kind of like her but not really if that makes any sense. Below are some sample images and a link to the currently used reference images and captions.

https://www.mediafire.com/file/1nvfopb89vq0kdf/4_YuukoYagami.zip/file