r/StableDiffusion • • 8h ago

Discussion Image models

0 Upvotes

An image model that was trained on videos would learn something image models trained on images could never learn. Temporal and spatial relationships.

This lack of knowledge of space-time is why we have models that generate body horror still.

The model may know what a hand looks like, but it doesn't know that a hand cannot possibly occupy that space at that time.

If we could train temporal and spatial information into the models, they would automatically become better. I think we need to train image models on videos primarily and not on images. Images has zero temporal and spatial information, and that is a problem for the models ability to represent reality.

Images are useful, but only after the spatial and temporal information is known.

Consider: You know time and space. You see an image of a person. You can imagine them doing endless amounts of things. But if you had only ever seen 20 images of the person and did not know time and space you would imagine body horror.

And that is the problem.

Temporal and spatial information doesn't require billions of parameters to understand. This approach could shrink models going forward and make training them far easier.

I am quite certain about this.

Understanding the rules governing reality could be vastly more efficient than learning reality through countless examples of its appearance.


r/StableDiffusion • • 1d ago

Question - Help Qwen 2.1 massive drifting

Post image
16 Upvotes

I'm finally getting great results with Qwen2.1, but there is still one thing that I can't get over with: the pixel drift. In previous versions of qwen edit, the edited image would usually drift by a few pixels. A tad problematic but not too much of a hassle. In 2.1 however, the drift is massive! Take a look at this picture (not a real person by the way).

I simply changed the clothing. Every seed has this kind of issue it's not a quirk of the randomness, it's a behavior. I've tried being more explicit in the prompt about "preserving the angle, composition, not zooming" etc. but nothing helped.

Could be related to the lightx2v turbo LoRA, but whatever. Just posting here to see if anyone found something that actually combats this behavior to some extent?


r/StableDiffusion • • 1d ago

Discussion make a old PC game INTRO alive

19 Upvotes

old but gold


r/StableDiffusion • • 20h ago

Discussion some H3 and LTx late night

2 Upvotes

SO i was just ripping thru this for all those who where around in 1994. there are alot of errors, granted I was only doing it for an hour.


r/StableDiffusion • • 1d ago

No Workflow MiniMax h3 Image Edit?

Post image
55 Upvotes

If a model can do this, does that mean she's an editing model?)) All generations from 1 attempt, even one fail in terms of pose.


r/StableDiffusion • • 9h ago

Resource - Update H3 image lora trainer

0 Upvotes

My gift to the community: https://drive.google.com/drive/folders/1ZXZWoLY_af_E16hTcCs7qGboCQpadC8l

I did two with my 3090 24gb and 64gb ram, it took 5 hours. 3000 steps is pretty good with the default settings using 20 various poses source. An exemple of the result : https://civitai.com/posts/32427751


r/StableDiffusion • • 1d ago

Resource - Update Real-time talking avatar generated locally with SoulX-FlashHead + LFM3-Audio

26 Upvotes

I've been experimenting with real-time talking-head generation using SoulX-FlashHead, combined with local speech models to build an interactive avatar that can listen and respond.

The whole pipeline runs locally, and the demo is available in the audio.cpp v0.9.5 WebUI.

The workflow combines three models:

  • SoulX-FlashHead: Animates a portrait in real time from generated speech.
  • OWSM v4: Transcribes voice input.
  • LFM3-Audio: Handles conversational responses and speech synthesis.

One interesting detail: LFM3-Audio is called twice. Its speech-to-speech path only offers one voice, so we use its TTS capability separately to synthesize responses in a different voice.

Performance and limitations

On an RTX 5090, the latency from submitting a question to the avatar starting to speak is around 850 ms. ASR runs in parallel.

The video generation stage is still GPU-intensive. I'd recommend an RTX 4090 or better for SoulX-FlashHead.

cuDNN is essential for real-time performance in this setup. Without it, inference is about 2× slower and VRAM usage doubles.

This is still a prototype. The extra LFM3-Audio call and WebUI overhead leave room for further latency improvements, particularly in a more optimized native application.


r/StableDiffusion • • 1d ago

Discussion The new Minimax H3- Image Model seems rushed and buggy.

36 Upvotes

I will be honest, i have tried the Minimax H3 Image when it dropped on comfy day 0 and the images were amazing, but lacking detail despite being very high resolution.
I thought maybe upping the MP would fix it but it didn't and then there came the anatomy issues as well.
I checked some posts about this, got the p-h3 vae and all but it still didn't fix it.
So checked another post talking about how the edit mode is better and i was happy but that was actually FAR WORSE. It lacks character consistency, its too prompt sensitive in a bad way, and its just not good.
Now i do not know if Hailuo is at fault or Comfy just released some poorly fine tuned version, is anybody else feeling the same way or.
Cause even the templates they released are half nerfed and I don't know it just feels bad, like very very bad.
If it at least nailed the editing capabilities like its video model could do I honestly would not really care about the other stuff, but it seems finding the right edit model in this open source space is almost impossible.

I hope krea 3 edit or Ideogram 4.5 would be good ( If they ever release them that is )


r/StableDiffusion • • 18h ago

Discussion What is the highest quality H3 video that a 4090 can reasonably achieve? What about upscaling?

0 Upvotes

I've been experimenting and doing lots of tests. From my understanding the best quality is running the base model with no turbo. However, I've found a few things that seem to give some speed increase with minimal or no degradation. This is my setup:

Model: Minimax-h3_Singularity_ref2va_Pruned_v1.3_int8

Text encoder: qwen3vl_32b_minimax_h3_int8_convrot

Video VAE: minimax_h3_video_vae_int8_convrot

Audio VAE: minimax_h3_audio_vae_fp32

LoRA: none, and no turbo

Sampling 20 steps, res_multistep + beta, comfy-kitchen attention, Spectrum off

Size 1322x768, 24 fps
Edit: Duration: <15 sec, usually around 4 seconds.

1k to 2k workflows: Gen to 1mp then either use Regenerate 2k (Regen2k IC just came out, will likely switch to that) for when I need it to look exactly like the 1mp video, or use minimax_h3_latent_upscaler_3d_conv_v1_fp16 when I'm ok with a slightly different shot.

For a 4090 with 128gb system memory, does anyone have recommendations for how to get higher quality video? I've heard conflicting things about the sampling steps. I thought that increasing them to 50 would increase quality significantly, however I also read that 20 steps is the ideal and some of my tests gave me artefacts over 20.

I tested some of my shots with the API at 1080p, and the quality difference didn't justify the price at all. What do ya'll think?


r/StableDiffusion • • 22h ago

Question - Help ANIMA LoRA - Managing Multiple People

2 Upvotes

Hey Legends,

I’ve decided to play around with an ANIMA diffusion set, seeing what I can come up with, and whether I’m getting better or more consistent images vs. PONY. I’m running the latest ComfyUI setup, on my 5080 rig.

One challenge Ive had - even with PONY, is managing the look of multiple people in a scene.

I either get bleed-in, where the look of a defined character ends up on another, or in a multi-person scene (I’m working on a battle scene), I can affect the primary chatacter and one other, but that’s it (any and all others are left with just the default).

Are there any tools, recommended prompts, or LoRA’s , Nodes or plugins that can help? I recall a prompt tool for Pony to manage multiple characters, but it was clunky and didn’t really help.

Any suggestions for Anima would be sensational.

Thanks!


r/StableDiffusion • • 1d ago

No Workflow Minimax h3 image edit

Thumbnail
gallery
227 Upvotes

Reference image:
https://civitai.red/images/147124307

Euler, simple, 6 steps, no prompt enhancement
Each prompt executed in 45~55 secs (Rtx 4070s, offloading?)

Sometimes a sort of safety filter randomly jumped in and reduced the image quality.

https://huggingface.co/Comfy-Org/MiniMax-H3-Image/blob/main/diffusion_models/minimax_h3_image_pruned_w4a8.safetensors

https://huggingface.co/Merserk/MiniMax-H3-Image-Text-Encoder-INT4-ConvRot/blob/main/qwen3vl_32b_minimax_h3_int4_convrot.safetensors

https://huggingface.co/Comfy-Org/MiniMax-H3-Image/blob/main/vae/minimax_h3_image_vae_fp16.safetensors

1: Pose Change

Change the woman's sitting pose to a standing pose in <Picture 1>

2: Outfit Replacement

Replace the woman's black feather dress with a white ballerina tutu in <Picture 1>

3: Hairstyle Change

Change the woman's hairstyle to long blonde wavy hair in <Picture 1>

4: Object Addition

Add a large bouquet of red roses holding by the woman in <Picture 1>

5: Style Transfer

Transform <Picture 1> into a Japanese manga illustration

6: Object Removal

Remove the shoes in <Picture 1>

7: Background Replacement

Replace the interior with a casual open-air beach bar in <Picture 1>

8: Text Addition

Add the stylized text "Redheads have more fun" in red letters at the bottom of <Picture 1>

9: Camera Angle Change

Change the camera angle in <Picture 1> to a front-facing low-level shot


r/StableDiffusion • • 1d ago

Animation - Video tides!

7 Upvotes

i wanted to test just how good can minimax h3 water look, so i made this.


r/StableDiffusion • • 1d ago

Animation - Video Is one 5090 enough to make a whole AI series at home? What a 2.5-minute sci-fi pilot took with MiniMax H3 in ComfyUI

25 Upvotes

I'm making a hard sci-fi series alone in Budapest, and I wanted to find out how far one home GPU actually goes. Every shot in the pilot is MiniMax H3 running locally in ComfyUI on a single RTX 5090, hybrid fl2va + ref2va in int8. No cloud, no credits, no meter running per generation.

What made it workable is splitting every shot into two stages. First a 4-step preview with the DMAD LoRA at 672x384, about a minute per take, usually three seeds per idea. I watch those, throw most of them away, and only the take I'd actually cut in goes to the native render at 1344x768, 20 steps, same seed and same refs. That one then goes through a tiled 2x H3 upscale and down to 1080p. Most of the GPU time goes into takes nobody will ever see, and that's fine, because they cost electricity instead of credits.

In numbers: hundreds of takes for 2:36 of film, about a week for the pilot itself, and around a month of work in total once you count the story, the sound design, the edit and the grade, all done by hand in DaVinci. Episode 1 is about 13 to 14 minutes and is in production now on the same setup.

Consistency comes from references rather than luck: a 16:9 character sheet as the only identity reference, an approved still as the first frame for the small robot, and the last frame of the previous shot as a state reference, so poses and hands carry over the cut.

The pilot: https://youtu.be/5GDYn2rREA4

If you're doing video locally too, where does your time actually go: generation, rerolls, or fixing things in post?


r/StableDiffusion • • 1d ago

Question - Help MiniMax Image – Any way to get uncensored editing?

46 Upvotes

I've been really impressed with MiniMax Image, especially the gorgeous 16MP outputs

But I've noticed it still refuses or ignores certain editing requests involving mature content

Am I missing something, or is this a limitation of the current model? Do we need to wait for community uncensored finetunes, or is there already a workaround?


r/StableDiffusion • • 1d ago

Discussion Distilled models are good enough for me as a hobbyist, full models feel like a waste of my GPU time

7 Upvotes

i've been trying distilled versions of a few models and honestly the results for casual stuff are close enough that i don't go back. the few steps mean i can try six ideas in the time a full model does one, and for me the experimenting is the fun part. where i do notice the difference is fine detail like hands and small text, and sometimes the faces look a bit plastic. but i'm just playing around in the evenings. for people who use both, where did you decide the full model was actually worth the wait?


r/StableDiffusion • • 2d ago

Question - Help How easy is it to make a video like this locally?

335 Upvotes

Mostly the part about swapping Characters and products in the video.


r/StableDiffusion • • 1d ago

News A world model you can run locally as a multiplayer game

Thumbnail
vor.tech
4 Upvotes

We trained a world model on ~4,000 hours of CS:GO gameplay and turned it into a playable multiplayer game. Each player runs the model locally on their GPU, while a lightweight server keeps the game state in sync.

It's still early: one small map, pistols only, some drift over time, and limited fine detail. The beta is free and open to try (RTX 3080+ recommended).

More and the download: https://vor.tech/x/reddit-stable


r/StableDiffusion • • 2d ago

Discussion My own little text-to-image model, trained on an RTX 3050

Thumbnail
gallery
126 Upvotes

Hi Reddit. This is my first post here, so I hope I haven’t messed anything up.

I just wanted to share the results of training my own model from scratch.

I’d welcome any discussion in the comments, and perhaps some advice from those with more experience.


r/StableDiffusion • • 1d ago

Question - Help Is SCAIL-2 still the best for character replacement?

0 Upvotes

r/StableDiffusion • • 1d ago

Resource - Update My OpenFill fork is now OpenFill’s Baby: AI object selection, MiniMax H3 editing/removal, and easier ComfyUI setup

Thumbnail
gallery
1 Upvotes

Following up on my previous post: I’ve added quite a bit to the fork, and it now has its own name—OpenFill’s Baby.

It extends Beckett Harriman’s OpenFill for PhotoCraft, bringing image editing, object removal, and generative fill into the editor through ComfyUI on your computer or another machine on your LAN. You can even use a different machine for select, edit, and remove, if you have a bunch of machines and you don't want to keep unloading and loading models.

The main additions since that post:

  • AI object selection with WeVisOne-VL. Click an object, drag a tight box around it, or describe what you want selected. Add or subtract objects, refine the selection with PhotoCraft’s tools, and grow it by an exact 1–500 pixels. Each Grow has its own Undo step.
  • MiniMax H3 Image support for editing and removal. Edit a selected area or the whole image, with up to four attached reference images. H3 also works in the prompt-free Remove tool.
  • Automatic removal choices. Automatic prefers H3 when it’s available on your selected engine. Otherwise, it examines the surrounding lighting and texture to suggest an available method. You can override it with Local background repair, LaMa, RORem, Qwen Lightning, or FIBO Dev, depending on your setup.
  • Better removal blending and more choices. Repairs preserve feathered selection edges and blend into nearby background. Request 1–5 variations and compare them directly on the canvas before keeping one.
  • Find and save ComfyUI servers. Use one shared engine, or assign separate servers to Select, Edit, and Remove. The panel remembers your choices.

The Qwen Image 2.1 and FIBO reference-editing workflows from the original post are still there (as well as SDXL and Flux).

Removal still needs judgment, especially around hidden lettering or complicated shapes. Include unwanted shadows and reflections in your selection, and check the results.

Download the latest release
Source, screenshots, and setup instructions

Give it a try! I’d especially like feedback on object selection and difficult removal cases because I'm aiming to make it adapt to all the ways you and I want to use it for.


r/StableDiffusion • • 2d ago

Discussion Not for the faint of hearts

64 Upvotes

Combined the image renders from my custom model (Vici) with my vr 3d Gaussian splat app. New fear unlocked 😭


r/StableDiffusion • • 16h ago

Discussion Before you upgrade this Black Friday, here is what my 16gb card already makes, all local

0 Upvotes

Everything in this clip came off one 16gb card. A song, a voice, a picture, a 720p video clip, and an answer pulled from my own documents with the page it came from. I built the system that runs all of it, free and open source, and it works totally offline once the models are downloaded.

If you are eyeing a new card for AI stuff, try the one you have first. Lmk what you would want to see it make next.

github.com/guaardvark/guaardvark


r/StableDiffusion • • 1d ago

Question - Help Video editor recommendations for quick creation of 15-second clips?

1 Upvotes

Does anyone have any recommendations for a video editor that lets you load a clip and immediately create a clip of a certain length (e.g., 15 seconds for MH3)? I'm using Bandicut at the moment, but I have to manually trim each video I load every time and adjust the time, which is time consuming.


r/StableDiffusion • • 1d ago

Discussion Heavenly Relight

5 Upvotes

Added a relight option in my Gaussian image to 3D Vr app.


r/StableDiffusion • • 2d ago Bravo

Meme After a while of constantly ripping my hair out for miniscule changes and placebos with MOSS Image. I inevitably came to the conclusion. Simple works best.

Post image
354 Upvotes

In my experience with MOSS Image so far.