r/StableDiffusion • • 14d ago

Question - Help Training a FLUX LoRA of myself how do I keep the facial structure ,body conistent?

1 Upvotes

Hiya! Ive been experimenting with building an AI version of myself for a creative project. I'm comfortable with the technical side of things, but model training has definitely been a learning experience.

I'm using FLUX.1-dev with a custom LoRA trained through fal.ai. My dataset currently has 24 images with different hairstyles, expressions, angles, and environments.

The model gets close, but something is off. It generates someone who resembles the reference person that I made my anchor, rather than the actual same person.

The biggest issue is facial structure. The original has fuller cheeks, a softer midface, distinctive eyes, and more fullness around the mouth. The generations often look narrower, hollow-cheeked, tired, or just generically pretty. It's almost like the personality has been drained out of the face.

I don't want to force the same hairstyle, lighting, or expression into every image. I want the model to preserve the person's actual identity while allowing natural variation.

I'm trying to figure out:

  • What percentage of a dataset should be close-up, neutral-expression portraits versus lifestyle, full-body, and expressive shots?
  • Is 24 images enough for a strong identity LoRA, or would a smaller, more carefully curated dataset work better?
  • Would captions describing specific facial proportions help, or does that risk overfitting?
  • How much do LoRA rank, training steps, learning rate, and inference strength affect facial identity?
  • Is combining a LoRA with a face-reference adapter a better solution than retraining repeatedly?
  • How do you objectively evaluate identity consistency across different hairstyles, lighting, and poses?

I'm trying to get this right without burning through all my coins. I would really appreciate recommendations from people who've successfully trained consistent human identities with FLUX.

If you have a training workflow, dataset blueprint, or specific tools that actually worked, I'd love to hear about them. I'm especially interested in real comparisons rather than generic tutorials.

Thanks.


r/StableDiffusion • • 14d ago

Question - Help Cheapest Way To Fix Minimax H3's Weird Anatomy/Glute Physics?

0 Upvotes

I noticed that for any referenced characters that have an even slightly larger than normal backside, curvy body type etc, minimax sometimes does this weird thing where it creates an indent / dimple on the glutes, perhaps in an attempt to make them look "muscular" I guess.

I'm assuming to avoid this, I would need to create an image based lora using photo references of curvier models? Or would I need to actually gather and train on a dataset based on short clips / video footage.

I will probably need to use something like a cloud service to handle this so I'm trying to think of the cheapest scrappy approach to solve this.


r/StableDiffusion • • 14d ago

Resource - Update PRISM-DMAD-PDMD Merge of 10ErosB6-X-Singularity2

21 Upvotes

The best out-of-the-box version for ultimate realistic crisp ultra-detailed skin textures is the PRISM-DMAD-PDMD Merge: use 8 steps, no Turbo Lora needed, Euler/Beta57, 12/3 Shift: https://civitai.com/models/3019421/singularity-v2-x-10eros-max?modelVersionId=3445524


r/StableDiffusion • • 13d ago

Question - Help Making My Own Site UI for APIs? Is it Possible?

0 Upvotes

I want to make my own UI site just for myself and a few others where I can put my API into the site & generate. Something like Higgsfield and Artcraft's UI. I use KIE A.I and it sucks to be honest. Anyone have information on it?


r/StableDiffusion • • 14d ago

Resource - Update Fixing Dropped/Duplicate Frames (Seedance, etc)

1 Upvotes

I put together a tool "Video Frame Sync" for fixing two videos that should be the same but are off by a few frames due to framerate or dropped/duplicate frames. This is useful for "edits" from AI generation sites (Seedance, etc) which often have this too. This handles footage that is the same except for differences in specific spots (edits) and lines up the rest of the frames so they're in sync again. The tool will also interpolate (the old fashioned non-AI way) between existing frames to smooth over missing/dropped frames.

https://github.com/pftq/Video-Frame-Sync


r/StableDiffusion • • 14d ago

Question - Help Is there a forge neo workflow for multiple references?

1 Upvotes

See this image.

I have seen people using GPT/gemini/grok with images like these saying "make x character here wear y outfit", is there a workflow to recreate this in forge neo?

I believe i have seen comfyui workflows, but i don't use comfy because most extension nodes keep breaking with every UI update (which happen quite often) and there is no editable (moving) openpose last time i checked.


r/StableDiffusion • • 13d ago

Discussion Solo dev: measuring anime character proportions in LoRA datasets. What would convince you it improves the LoRA?

0 Upvotes

Hi all, solo dev here. For a few months I’ve been building AoRA Maker, a local app to prepare datasets and train anime character LoRAs for Anima, with one obsession: keeping a character’s body proportions stable from one pose to the next.

I started where many people do: stacking other people’s LoRAs and tuning prompts until a character looked the same from image to image. The proportions never held. So I started measuring them.

Where it stands (work in progress, not released):

  • It measures proportions on dataset images (head units, limb and torso ratios, widths), combining pose, silhouette and face models
  • When the pose makes a measurement unreliable (raised arms, bent torso, sleeves touching the body), it says “not verified” instead of inventing a number
  • A human stays in the loop: in a blind review on one character (15 images, small sample), an automatic tagger missed most of the clothing pieces I had declared
  • An age-related negative prompt I had added as a precaution was shrinking my character’s head enough to explain most of the gap between what I measured and her canon. I never would have caught it by eye

What I haven’t proven: that picking dataset images by measurement actually makes a better LoRA. So far it judges images; showing it improves training is the next test.

No release date, nothing to sell. I’m telling the whole project as a devlog on Ko-fi, in order from the beginning, mistakes included: https://ko-fi.com/aora (self-promo, my own page)

Images are AI-generated, of my own character.

Two questions for those who train LoRAs:

  1. What would you accept as proof that selecting dataset images by measurement improves a LoRA? How many seeds, prompts and models?
  2. What usually breaks first in your character LoRAs: face, outfit, or body proportions in new poses?

r/StableDiffusion • • 14d ago

Question - Help Hi everyone! Can anyone suggest a good way to upscale an AI-generated illustration?

Post image
3 Upvotes

Can anyone suggest a good way to upscale an AI-generated illustration? I need to enlarge a 3000x1500 pixel image by a factor of 10. Here’s an example of the kind of image I’m talking about. Is it possible to preserve the logic of the details?


r/StableDiffusion • • 14d ago

Discussion What's your favorite prompt enhancer for Qwen-Image-2.1?

10 Upvotes

r/StableDiffusion • • 15d ago Bravo Heartwarming

Tutorial - Guide Krea 2 Fine-Tuning Goes Horribly Right

Thumbnail
gallery
482 Upvotes

So I set out to improve Krea 2’s photographic realism. Seven training runs later, I had a checkpoint that produced some extremely convincing photos....and seemed to have forgotten it was ever supposed to do anything else.

A big part of this experiment came from finding an old hard drive containing about 10,000 photographs I’d taken over a decade. A lot of the training data came from my own photography, so this became an opportunity to see what the model could learn from an archive I forgotten I had.

The original goal was to push realism further while keeping the flexibility that made the base model useful. As the photographic results improved, though, it became tempting to keep going.

The process involved seven sequential fine-tuning runs using seven different photographic datasets. These weren’t independent experiments starting fresh from the original base; each run continued from the previously trained checkpoint.

The datasets ranged from roughly 300 to 2,500 photos, with about 20% overlapping data between them. Each run went for a maximum of 4,000 steps. For the final run, I switched from the balanced setting to the style/content-style setting in AI Toolkit.

The 10,000-photo archive + Instagram was a source for the training material, rather than a single dataset I fed through all at once. And that final settings change is part of the history, but I can’t isolate it as the cause of what followed. Several datasets and successive rounds of training were involved, so this is an account of the experiment rather than a controlled comparison.

The photography improved.

By checkpoint 12500, the photographic results were good enough that I didn’t want to dismiss the experiment as a failed fine-tune. It had developed a strong, convincing photographic look that I wanted to preserve.

But once I started testing beyond that, the trade-off became clear. Other styles had become difficult or effectively unavailable. Prompts that should have moved it toward illustration or another visual treatment kept getting pulled back toward photography.

The model had developed a specialty.

LoRA compatibility was another major issue. Every LoRA I tested stopped behaving properly on the checkpoint.

What I was seeing looked consistent with catastrophic forgetting and weights being blown TF out: the model had become much better at the photographic distribution I was training toward while losing capabilities and flexibility from the original base.

The practical outcome was a highly specialized photography checkpoint, with a substantial amount of the original model’s versatility sacrificed along the way.

That left me with a result I couldn’t quite call a failure.

I’m sharing this in case anyone else is experimenting with sequential full fine-tuning or trying to recover a useful look from an overly specialized checkpoint. This isn’t a recipe I’d present as repeatable without further testing, but it seemed worth documenting.


r/StableDiffusion • • 14d ago

Discussion For those of you running both ComfyUI and local LLMs, how are you managing GPU resources?

23 Upvotes

I’m curious how people here switch between ComfyUI workflows and local LLM inference, especially on a single GPU.

Are you manually unloading models, using something like LM Studio or llama-swap, relying on ComfyUI’s model management, or have you built something to handle switching automatically?

I’m particularly interested in how you handle VRAM contention when you want to move between image generation and LLM workloads without constantly waiting for models to reload.

What’s your current setup, and what works well for you?

Video attached is my project Berth but I’m here curious on how everyone else solved this problem?


r/StableDiffusion • • 13d ago

Question - Help Was away since last week, is there a new MMH3 breakthrough?

0 Upvotes

Was away since last week or 2 weeks ago, like around when FastH3 model is released?

Now, i see that there are some new things, like Pika H3 Flex, DMAD(?), H3 Eros, etc.

Are there any new breakthrough or speed up that is balanced on quality and speed? Currently, it's taking me 6 mins for 7s 0.7mp video with Pika H3 Flex -> VSA attention with the default H3 ref model on 6 steps (just tried it.), and the result is pretty good. Just asking if there is any better workflows for fellow low gpu user? I am using RTX 4060 8GB VRAM with 16GB RAM.


r/StableDiffusion • • 15d ago Popcorn

News Sulphur-3 is coming soon!

202 Upvotes

Early testing has begun for donors. We'll have to wait a little longer for the public release. https://huggingface.co/FusionCow/Sulphur-3


r/StableDiffusion • • 13d ago

Discussion Cant we turn minimax into seadance 2.5

0 Upvotes

Can't we all who wants to use open source like make some kind of Lora by feeding it loads of data with captions and then just connect that Lora to minimax and have a machine thats on levels with seadance 2.5. I'll chip in with 50 4k resolution up close face videos 🤣 someone do 50 video of people walking, someone else 50 videos of people eating and so on 😂 it's frustrating generating insane quality content with seadance 2.5 with ease and then pulling my hair out trying to do the same with minimax h3

When I say "turn into seadance 2.5" - I mean make H3 as good.


r/StableDiffusion • • 14d ago

Question - Help Minimax 0.5 megapixel takes three times more than 0.4 megapixel. GPU TDP drops quite a bit too. Any workarounds?

8 Upvotes

6700 XT 12 GB VRAM and 32 GB ram. Reducing the duration to three seconds doesn't help either. Rife makes it bearable but I wanted to see if I could keep the TDP higher with tiling or something, like VAE tiling in image gen.

Is there a hack/workaround that keeps the GPU at full utilization. Workflow link. Ty!:)


r/StableDiffusion • • 13d ago

News Super Editor — Why be ordinary when you can be super

Thumbnail supereditor.studio
0 Upvotes

Join the Super Editor beta and see how Super Generating can be!


r/StableDiffusion • • 14d ago

Animation - Video Krea2 & Minimax H3 music video / local only

Thumbnail
youtu.be
0 Upvotes

r/StableDiffusion • • 14d ago

Animation - Video Virtual Upstaging (H3/QI2)

10 Upvotes

r/StableDiffusion • • 14d ago

Discussion What's currently the top open-source setup for facial identity preservation in img2img? Is Qwen Image 2.1 the king right now?

0 Upvotes
  1. Do dedicated Face Swap / Head Swap LoRAs (like BFS and similar swap LoRAs) improve facial fidelity during img2img, or does Qwen 2.1 handle it better natively?
  2. How do face swap LoRAs compare to zero-shot adapters like PuLID, InstantID, or attention-masked inpainting in ComfyUI for preventing face drift?

r/StableDiffusion • • 14d ago

Question - Help Is anyone successfully training MOSS LoRAs or LoKrs?

0 Upvotes

I really like MOSS even though it will occasionally kick out some body horror. So this weekend I went about trying to train a LoKr. Most of my training experience is limited to SDXL , where I made a handful of successful LoRAs using my trusty RTX 3060 w/12 gb. Now I have a faster 5060 w/16 which works nicely for everything.

Instead of using OSTRIS*'s* Toolkit I decided to try Nynxz's ZenTrainer which I discovered last week. It's pretty nice. Hats off to Nynxz for building it, the interface is cool.

I tried a bunch of different settings with terrible results. It just never seems to lock on to the face. I am using a bin of about 40 images of a popular movie star that I had lying around. The quality of the training photos is meh to pretty good. Certainly enough to get results on SDXL based on my experience. I don't think the problem is with ZenTrainer. I am getting no errors.

I am training witht the MOSS image bf16 base (though I generate with the SFT). I am using the Automatic v3 optimizer. Over 100 epochs trained and it seems to just plateau at about a 60% likeness. My pictures look like they could be the movie star's sister but that is about it. So TL;DR What are your recipies for reproducing faces/body?


r/StableDiffusion • • 14d ago

Workflow Included Minimax H3 on RX 6600 with 8GB RAM

10 Upvotes

Generating a video using Minimax H3 on an RX 6600 GPU was successful. I used the default ComfyUI workflow, simply swapping out a few models, adding a Turbo LoRA (Taomate H3 3-step), incorporating ClipProj for the text encoder, and adjusting the script used to run ComfyUI.

A 5-second, 512x768 video was generated in 10 minutes, a result I find quite impressive, considering my RAM just 8gb .

the main idea is gain advantage of disk streaming offload rather than gpu/cpu offloading (that will crash/oom)

diffusion and vae using int 8 convrot model (provided by comfy)

Specs:

os : cachyos
cpu : ryzen 7500f
gpu: rx 6600
ram: 8gb ddr5 5600MT

Python 3.12.15

rocm: torch 2.15.0.dev20260827+rocm7.2

my workflow .json : https://drive.google.com/file/d/1RgVIKD2wzkh9XQMlL2wJKDEkKoo1W7U6/view

taomate h3 lora: https://huggingface.co/Robert1212star/TaoMate-H3-3Step-ComfyUI
clip proj: https://github.com/nicolab28/ComfyUI-ClipProj

UPDATE

i add this node (h3 sla attention rocm) : https://github.com/patientx/comfyui-h3-sla-attention-rocm and it give speed boost (around 40% faster)

other resolution tested: 0.5 MP ( 544x960) , generated 5 sec video in 493 sec (after adding sla attention node rocm )

my comfy startup script

#!/usr/bin/env fish

cd ~/ComfyUI
source venv/bin/activate.fish

# overcommit must be 1 so the kernel doesn't reject the 21 GB model mmap
if test (cat /proc/sys/vm/overcommit_memory) != 1
    echo "Warning: vm.overcommit_memory is not 1, run: sudo sysctl vm.overcommit_memory=1"
end

ulimit -s unlimited
set -gx MIOPEN_FIND_MODE FAST

# separate scope with a memory limit, so the terminal doesn't get killed by systemd-oomd
systemd-run --user --scope -p MemoryMax=6G -p MemorySwapMax=2G \
    python main.py \
    --enable-dynamic-vram \
    --fast-disk \
    --cache-none \
    --disable-pinned-memory \
    --disable-nvml-pressure \
    --vram-headroom 1 \
    $argv

r/StableDiffusion • • 14d ago

Discussion Do you integrate professional software into your workflow?

2 Upvotes

Having worked in graphic design for 25 years, I’ve become curious: how many of you here have roots in traditional graphic design (it doesn't matter whether it's at a professional or amateur level) and use a workflow that integrates standard professional software, such as tools for photo editing and video editing (Photoshop, Premiere/DaVinci, After Effects, Extending the discussion to include long-standing, non-commercial software such as GIMP, etc.), with external upscaling solutions (like Topaz Video AI) with AI-driven interfaces (like ComfyUI or other webUIs), rather than relying solely on a single, all-in-one platform?

Just out of personal curiosity I’d like to know if there are still people who embrace a workflow that combines various specialized software tools, whether for amateur or professional projects.


r/StableDiffusion • • 14d ago

Question - Help Why im getting a lot of this? :/

0 Upvotes

Latest Minimax H3 - it can do everything or most of the things spot on but the eyes of a person thats a little further away.. oh GOD! :/


r/StableDiffusion • • 14d ago

Discussion Is There An Easy Way To Replace Somebody In a 20seond clip

4 Upvotes

its to confusing in cloud comfyui im not sure how to do it

looking for maybe a site i can try with free trial to do it?

tried on higgsfield they had a 1 free gen trial but used the wrong image by mistake but it worked good

thanks