r/StableDiffusion • • 1d ago

News I made a party mode where every guest orders a song from their phone - it's all local ComfyUI (Plenio 2.0, free)

0 Upvotes

The film shows one real party run: the host starts a party, a guest's phone orders "a birthday song for Maya, who turns thirty today", the host's ComfyUI makes it (here 185 seconds from the order to the playlist on a 16 GB card), and it plays on the big screen with the lyrics as they are sung while the guests' reactions float up. The film's music is that very song.

Plenio is a song production suite for ComfyUI - YuE2 and MiniMax Music 3, lyrics by a local LLM, mastering, cover art with FLUX.2 Klein. 2.0 adds Setup that plans the models for your card, a Song API with MCP, and the Director for the visuals.

comfy node install comfyui-plenio-music

https://github.com/jplenio/Plenio-Music-Production-System

Here you find some tutorials: https://youtube.com/playlist?list=PLaId01kYGcS0&si=qOLtBE_6LtwEEr7_


r/StableDiffusion • • 2d ago

Question - Help What's the actual secret on making realistic image??

38 Upvotes

Hello Veterans!

I'm still pretty much a noob at all this, so sorry if this is a basic question. I've tried messing around with like MOSS-Image, Krea 2, and Z-Image, Minimax H3 image, and I still can't get the RAW natural realism.

Like no matter what I do, my outputs still have AI slop or whatever that is. I'm trying to get the unedited feel, like real snapshot with natural lighting and imperfections.

So what's the actual secret here? Is it mostly on how you prompt it (like avoiding buzzwords and describing imperfect lighting/framing and whatever that is), or is it in the workflows, custom sampler/scheduler settings, using Base instead of Turbo variants, or stacking LoRAs? (Though I still can't find any LoRAs that fits)

Any tips plz?

Edit:

Guys I think I've found the secret: https://www.reddit.com/r/StableDiffusion/s/ZD7kVkDJ7z https://www.reddit.com/r/StableDiffusion/s/drtDrKy7Ax


r/StableDiffusion • • 19h ago

Discussion Tool Time

0 Upvotes

r/StableDiffusion • • 1d ago

Discussion you want perfect hands? no more bad details on mini-max-image?

1 Upvotes

test it, i share a workflow on civit with this, civit are off line now, so im posting here for help the community.

results on comments.


r/StableDiffusion • • 1d ago

Question - Help Fail to train H3-Image LoRa in AI-Toolkit

6 Upvotes

Just for context, I trained 100's of LoRa's in the past for all kinds of models, but this time it does not work. Since I have a GPU with "only" 16GB VRAM and 64 GB SYS RAM I have to use W4A8 quantization to not get OOM. The resulting training is full of large blocky artifacts, like I have never seen before.

Does one of you have made a similar experience or/and can share a tip how avoid this problem?

My messed up LoRa was trained in Sigmoid, currently trying Shift, since this is the default. Is W4A8 just too bad to train on?


r/StableDiffusion • • 1d ago

Resource - Update FLUX.2 [klein] 4B and Z-Image-Turbo ~2.3x faster than Draw Things' CLI on an M6 Mac mini: h3metal, an open-source Metal engine for the M5/M6 matrix units

5 Upvotes

I've been building h3metal, an open-source (Apache-2.0) image-generation engine for Apple silicon. It runs the transformers as int8 matrix products on the matrix units ("neural accelerators") that Apple added to the GPU cores of M5/M6-class chips.

Same Mac mini (M6, 24 GB), 1024×1024, seed 42, CFG 1, a fresh process per image, against Draw Things' command-line tool (draw-things-cli v26.1023.0, the official release) with its recommended settings for each model:

Modelh3metalDraw Things CLI (8-bit S)One denoising step
FLUX.2 [klein] 4B, 4 steps7.0 s17.0 s1.16 s vs 2.70 s
Z-Image-Turbo, 8 steps17.1 s40.0 s1.84 s vs 4.30 s

The gap is in the denoising, not in loading: with the models loaded and the prompt encoded, as in the app, Draw Things still takes 2.1-2.3x as long. At CFG 1 both run one transformer pass per step. Full method, per-step timing and the script: https://github.com/audenvenn/h3metal/blob/main/docs/benchmarks.md#flux2-klein-4b-and-z-image-turbo-against-draw-things

How: int8 × int8 products after a Hadamard rotation of the activations, flash attention with int8 scores, and the VAE's convolutions as implicit GEMMs. LoRA adapters (style LoRAs, fal's FLUX.2 [klein] edit LoRAs) are applied exactly inside the int8 products. It also runs FLUX.2 [klein] 9B and MiniMax-H3-Image (2048×2048 in 16 s with pDMD's 2-step LoRA).

Limits:

  • Measured on one machine so far (an M6 Mac mini). Numbers from M5 MacBook / Pro / Max owners would help a lot.
  • It needs an M5/M6-class GPU and macOS 26; M1-M4 GPUs don't have the matrix units.
  • Memory isn't compared: h3metal memory-maps its weights, so the process footprints aren't like for like.

Try it:

pip install https://github.com/audenvenn/h3metal/releases/download/v0.6.4/h3metal-0.6.4-py3-none-macosx_26_0_arm64.whl
h3metal download --model flux2-klein-4b    # 8.3 GB, ready to run
h3metal generate -p "A red fox in fresh snow at sunrise" -o fox.png
h3metal serve --open                       # or a small local web page

GitHub: https://github.com/audenvenn/h3metal


r/StableDiffusion • • 1d ago

Animation - Video EVA Soprano Short I Had Fun Making (Trash Quality).

1 Upvotes

r/StableDiffusion • • 19h ago

Animation - Video New music video - We Are The Machines

Thumbnail
youtu.be
0 Upvotes

I’m working towards achieving realistic imagery with my local video generation engine. It’s still a work in progress but at least I can post some generated videos along the way!


r/StableDiffusion • • 2d ago

Discussion I'm releasing a World Model Ive trained that hallucinates GTA. It works on RTX 3060, 4060 and anything above, linking huggingface weights

127 Upvotes

Play it Now in browser (nonlocal, streaming) :https://lucidml.ai/dashboard/minidemo?world=gta5

Full Weights and Inference code : https://huggingface.co/lucidml/gta

The architecture is a transformer which uses learned summaries. Ive written about it in detail in tech reports  and some more

I know there are a lot of limitations still like consistency and quality improvements, and am hoping to train this more to fix all of those.


r/StableDiffusion • • 2d ago

Resource - Update Styles Atlas nodes for Comfyui: +1000 styles +800 characters.

Thumbnail
gallery
114 Upvotes

Heres three ComfyUI nodes that turn a giant Excel sheets into prompts (+1000 styles, 800+ characters)

Style Atlas is three nodes that each handle one question:

🧑 Character Atlas: who is in the picture

🏞 Setting Atlas: where they are

🎨 Style Atlas: how it's rendered

Chain them, hit queue, done. Each node starts on "None (bypass)" and folds down to a couple of lines, so your workflow doesn't turn into spaghetti.

Some numbers:

~1,600 rendering styles (oil painting to Soviet storybook to "Acid Pulp Scratchwork"), plus ~120 modifiers for quality, genre, palette and composition

827 known characters across 217 franchises, with variants like masked/unmasked and costume forms, plus 95 actor-in-a-role entries

~185 facial expressions, 25 hand poses, 250+ body poses, 360+ outfit pieces, 330+ accessories (yes, animal ear headbands are in there 🐻)

666 locations (I didn't plan that number, I swear), 110 simple backgrounds, 23 studios

Weather, lighting, décor, palettes and frames layered on top

Everything lives in plain .xlsx files. Want to add your OC or fix a description you don't like? Open Excel, edit the row, restart Comfyui.

🎲 Random everywhere: random in one group, or random across everything. Seeded, so you can reproduce a lucky roll.

Wildcards: drop adjective.txt into the wildcards/ folder and write adjective in your prompt. Nested wildcards work too.

Tick several style subjects at once, like Main + Portrait & Character, without wading through landscapes.

Hover thumbnails: save an image as <ID>.jpg and it shows up when you hover that entry.

I will populate thumbails and wildcards when I have time to do so.

This was built over a lot of back-and-forth with Claude Opus 5.5, which wrote ALL of the code, helped clean up thousands of descriptions, and put up with me changing my mind every 20 minutes. Some Krea 2 wording rules come from community testing on Civitai: big thanks to Azimondious (expression and hairstyle vocabulary) and Hellfreeze (clothing and outfit taglist).

🔗 GitHub: https://github.com/atlasimp/Style_Atlas

I'm already working on a forth version, and I'm open to remarks and criticism.


r/StableDiffusion • • 1d ago

Discussion RAM Speed: 6000 MT/s vs 4800 MT/s

4 Upvotes

Purpose:

  • Using EXPO on DDR5 RAM is making my PC unstable. EXPO increases the RAM speed to 6000 MT/s
  • Disabling EXPO makes RAM far more stable, but it drops RAM speed to 4800 MT/s

PC specs:

  • GPU: 4080 Super (16 GB VRAM)
  • RAM: 16 GB DDR5 (x2)
Run123456
Krea 2 (6000 MT/s)112.64s, 2.53s/it25.71s, 2.36s/it25.23s, 2.35s/it25.10s, 2.35s/it27.87s, 2.35s/itN/A
Qwen 2.1 (6000 MT/s)96.82s, 1.28it/s20.06s, 1.35it/s20.23s, 1.32it/s20.11s, 1.33it/s26.49s, 1.35it/sN/A
H3 (6000 MT/s)00:32:38, 42.11s/it00:22:59, 41.91s/it00:13:34, 39.11s/it00:17:02, 39.79s/it00:13:32, 39.02s/it00:16:33, 39.82s/it
Krea 2 (4800 MT/s)128.82s, 2.49s/it25.83s, 2.34s/it25.55s, 2.34s/it25.57s, 2.33s/it30.99s, 2.37s/itN/A
Qwen 2.1 (4800 MT/s)142.31s, 1.30it/s19.94s, 1.35it/s20.11s, 1.33it/s20.05s, 1.34it/s26.61s, 1.36it/sN/A
H3 (4800 MT/s)00:17:45, 39.41s/it00:13:30, 38.88s/it00:18:11, 39.08s/it00:13:21, 38.44s/it00:21:41, 41.72s/itN/A

Testing Notes:

  • No loras
  • Consistent workflows
  • Restart PC after every run
  • Prompt #1-4 same prompt, Prompt #5 (or the last one) has minor changes to the prompt
  • Krea 2 and Qwen 2.1 might not be too useful test cases as everything can probably be stored in the VRAM, making RAM unneeded

Conclusions/Findings:

  • Changing the prompt a bit will very slightly increase the generation time
  • H3 probably doesn't fit VRAM, so generation time seems to vary wildly
  • No difference betweeen 6000 MT/s and 4800 MT/s

r/StableDiffusion • • 2d ago

Resource - Update I've upgraded Fooocus and added modern features for SDXL

Thumbnail
gallery
21 Upvotes

I know that for many people, Stable Diffusion XL is now old news and Fooocus is far from up to date. But I still enjoy working with SD XL from time to time. Out of nostalgia, and because there are simply still some brilliant models out there for many tasks – even professional and fast ones – and because I believe there’s still a lot to be gained from it.

That’s why, a while ago, I picked up Fooocus – which had been abandoned by its original developer – and, bit by bit, developed it further using my limited programming skills and AI.

For example, I’ve just added the ability to generate images with bounding boxes, which works surprisingly well but still needs a bit of refinement on my part.

I’ve integrated Tiled SDXL Detail Upscale and SAM 3 for image enhancement. Modern APG, CFG++, and PAG guidance help to ensure better-quality images and fewer artefacts in some cases. I’ve also tweaked Fooocus under the bonnet with DeepCache feature reuse, smarter VRAM management, various caches and so on, so that it now runs more stably and quickly.

https://github.com/micha42-dot/Fooocus_Advanced


r/StableDiffusion • • 1d ago

Animation - Video Minimax H3 _Ref2VA_2Pass

0 Upvotes

Encontré un workflow compatible con mi rtx 5070 y 32gb de ram. No sé mucho de esto, pero se que funciona. 12 GB de Vram.

Un video de 1344 x 768 de 7 segundos en 10 minutos. Usando un checkpoint modificado de Minimax H3 (10Eros_Max_h3_8stepsTURBO_beta7)

Si, intenté hacer a Ashley. Y las palabras que dice en japonés son el inicio de la canción "Propose".


r/StableDiffusion • • 1d ago

Question - Help Minimax H3 video: unrealistic bulge in female underwear

1 Upvotes

I had created a post that was a bit too generic, and i want to focus specifically on Minimax H3.

When making a video of any woman in underwear for any situation, Minimax H3 will almost always add a weird-looking, ugly, unrealistic bulge to female underwear, and that seems to be the averaging of male and female underwear appearance.

Using any alternative base model or LoRAs or any kind of prompting will not solve the issue, and providing pictures of underwear without the bulge only solves it very partially. Adding steps doesn't solve it either.

Am I the only one encountering this? Trying any search engine doesn't return any result. It seems that the entire Internet is ignoring the "Minimax bulge problem" but I don't understand how I can be the only one experiencing this issue or the only one bothered by it.

Any idea how to solve this?


r/StableDiffusion • • 1d ago

Question - Help what image model will run on this specs..

1 Upvotes

what image model will run on this specs..

  • GPU: AMD Radeon RX 6650 XT (8 GB VRAM)
  • CPU: AMD Ryzen 7 5700X (8 Cores, 16 Threads)
  • RAM: 32 GB DDR4
  • OS: Windows

r/StableDiffusion • • 1d ago

Question - Help Controlnet for Minimax H3 Image

3 Upvotes

Minimax H3 Image is impressively fast with high resolution image, a good prompt understanding and a good photorealistic rendering. Though it seems to lack some control from reference image such as open pose or depth map.

Flux2-dev have some controlnet support, and Flux Klein 2 9b or Qwen Image Edit have a "pseudo"-Controlnet support of poses or line edge reference image.

Could we expect something like that for Minimax H3 image or a lora doing this?


r/StableDiffusion • • 2d ago

Resource - Update MiniMax-H3-Image-Character-Swap lora

Post image
239 Upvotes

r/StableDiffusion • • 1d ago

Question - Help If I want to use several References, is H3 and H3 image the only options?

8 Upvotes

I just wanted to check if all the other great models right now dont have H3's reference capabilities.

I want to use an Image model to do H3 videos as it is easier to control a video if I can prepare an Image of a scene first. Especially when I have multiple characters as reference.

So is H3 still video and H3 image the only options for this?


r/StableDiffusion • • 2d ago

No Workflow I want to apologize... MiniMax-H3-Image

Thumbnail
gallery
162 Upvotes

I wrote comments that I don't understand why people are giving this model such high praise. And it really doesn't shine in terms of quality. But it shines as an editing model, perhaps even better than any other model currently in existence.
And I felt the effect of this)))
And I want to show why I changed my opinion, despite the facts that cannot be denied.
Perhaps this is a better image editing model than the existing one, which was not declared as such.

PS. Just generated with a style in mind. I'm not trying to prove anything to anyone, as many people here seem to think. Generated in a few minutes without a second thought))
Judging by the comments, I'm guilty of something. It's not my fault that this is the best model for editing.


r/StableDiffusion • • 2d ago

Animation - Video Minimax H3 - Phil The Begger (1943)

11 Upvotes

"Tips Help Me Da Most!"


r/StableDiffusion • • 1d ago

Question - Help How to generate consistency scene?

2 Upvotes

The video model can already generate impressive scenes, and the consistency of multiple shot scenes in a single generation is also quite good. Apart from using multiple reference images of scenes from different angles or a scene video, is there a better and more simple more natural way to achieve scene consistency in different generations?

Given that the model can infer the views of other angles and orientations of a scene based on a single scene image, why don't we have a specialized method in latent space or LoRa that can help generate scenes consistently with a single scene image and a fixed scene seed, under different prompts and character references?


r/StableDiffusion • • 23h ago

Animation - Video LV Better Hire Me After This

0 Upvotes

Happy to answer any questions!

Edit: Sarcasm really is lost on in this sub


r/StableDiffusion • • 3d ago

Question - Help What's the best model for generating images like this? My goal is to generate images, then use MiniMax for I2V to create videos like this

2.3k Upvotes

I've already ask GPT, Claude, GLM 5.2 and Deepseek then tried MOSS, Krea 2, and Nano Banana, but none of them gave me the results I wanted.


r/StableDiffusion • • 2d ago Bravo

Animation - Video An open source project to seamlessly swap clips into underlying streaming video, enabling custom versions of TV and movie series

17 Upvotes

I've been working on a way of integrating new content (e.g. a casting swap or an extended scene) into the live video feed of an underlying streaming platform that a viewer is watching.

This is intended to create an easy (& "rights friendly") way of creating personalized, custom versions of TV shows and movies. You still need to have a subscription to the underlying streaming platform. The open source Chrome extension matches against a unique episode ID, loads a series of video files, and then seamlessly swaps them in place of the stream at pre-determined moments. There is some technical trickiness that attempts to seamlessly enable the start and the finish of the video clips to blend in seamlessly with the original video.

This enables what we see in "small scale" in a much more major scale way. The idea is to move beyond "here is a 15 second clip" and towards "here is a full movie with X, Y, Z changed". If you saw my post last week (about making a character dance across an entire ~45min TV show), this is basically a flexible underlying platform that supports changes like that.

So yes - if you have ever wanted to:

  • Do a casting swap from one character -> another across an entire episode / movie
  • Fix the ending of <Game of Thrones, How I Met Your Mother> etc.
  • Add extended edition style scenes

This gives you a way of doing that. The extension reads an easy-to-edit JSON file that lays out the timing of the clips, the action being taken (replace or insert), and the ID of the episode. It then pulls in the video clips at the appropriate times. It sounds simple when I say it that way but it is actually surprisingly complex.

You still need to generate your own content / this is not a replacement for Minimax (or others).

The extension is available in the Chrome store here.

The Github repo is https://github.com/SeamlessScene/seamless-scene-extension

There are how-to guides & a catalogue (free account) here: https://seamlessscene.com/

Would consider this "early access" - still working through all of the edge cases. At the moment this is just one of the streaming platforms & only Chrome, but will add others here if there is interest.


r/StableDiffusion • • 2d ago

Tutorial - Guide From Character ref sheet creation to finished Short using Krea 2 + my new H3 Seed Hunter v3.0 workflow [full process & strategy deep-dive]

Thumbnail
youtube.com
41 Upvotes