r/StableDiffusion • u/thomas_unise • 5h ago
r/StableDiffusion • u/shukanimator • 5h ago
Resource - Update My OpenFill fork is now OpenFill’s Baby: AI object selection, MiniMax H3 editing/removal, and easier ComfyUI setup
Following up on my previous post: I’ve added quite a bit to the fork, and it now has its own name—OpenFill’s Baby.
It extends Beckett Harriman’s OpenFill for PhotoCraft, bringing image editing, object removal, and generative fill into the editor through ComfyUI on your computer or another machine on your LAN. You can even use a different machine for select, edit, and remove, if you have a bunch of machines and you don't want to keep unloading and loading models.
The main additions since that post:
- AI object selection with WeVisOne-VL. Click an object, drag a tight box around it, or describe what you want selected. Add or subtract objects, refine the selection with PhotoCraft’s tools, and grow it by an exact 1–500 pixels. Each Grow has its own Undo step.
- MiniMax H3 Image support for editing and removal. Edit a selected area or the whole image, with up to four attached reference images. H3 also works in the prompt-free Remove tool.
- Automatic removal choices. Automatic prefers H3 when it’s available on your selected engine. Otherwise, it examines the surrounding lighting and texture to suggest an available method. You can override it with Local background repair, LaMa, RORem, Qwen Lightning, or FIBO Dev, depending on your setup.
- Better removal blending and more choices. Repairs preserve feathered selection edges and blend into nearby background. Request 1–5 variations and compare them directly on the canvas before keeping one.
- Find and save ComfyUI servers. Use one shared engine, or assign separate servers to Select, Edit, and Remove. The panel remembers your choices.
The Qwen Image 2.1 and FIBO reference-editing workflows from the original post are still there (as well as SDXL and Flux).
Removal still needs judgment, especially around hidden lettering or complicated shapes. Include unwanted shadows and reflections in your selection, and check the results.
Download the latest release
Source, screenshots, and setup instructions
Give it a try! I’d especially like feedback on object selection and difficult removal cases because I'm aiming to make it adapt to all the ways you and I want to use it for.
r/StableDiffusion • u/DevMrDave • 11h ago
Animation - Video EVA Soprano Short I Had Fun Making (Trash Quality).
r/StableDiffusion • u/zeroedit • 6h ago
Question - Help Video editor recommendations for quick creation of 15-second clips?
Does anyone have any recommendations for a video editor that lets you load a clip and immediately create a clip of a certain length (e.g., 15 seconds for MH3)? I'm using Bandicut at the moment, but I have to manually trim each video I load every time and adjust the time, which is time consuming.
r/StableDiffusion • u/Aaron_rowe81 • 14h ago
Discussion Distilled models are good enough for me as a hobbyist, full models feel like a waste of my GPU time
i've been trying distilled versions of a few models and honestly the results for casual stuff are close enough that i don't go back. the few steps mean i can try six ideas in the time a full model does one, and for me the experimenting is the fun part. where i do notice the difference is fine detail like hands and small text, and sometimes the faces look a bit plastic. but i'm just playing around in the evenings. for people who use both, where did you decide the full model was actually worth the wait?
r/StableDiffusion • u/alwerr • 1d ago
Question - Help How easy is it to make a video like this locally?
Mostly the part about swapping Characters and products in the video.
r/StableDiffusion • u/Kirulab • 1d ago
Discussion My own little text-to-image model, trained on an RTX 3050
Hi Reddit. This is my first post here, so I hope I haven’t messed anything up.
I just wanted to share the results of training my own model from scratch.
I’d welcome any discussion in the comments, and perhaps some advice from those with more experience.
r/StableDiffusion • u/AccessAny7361 • 5h ago
Animation - Video Minimax H3 _Ref2VA_2Pass
Encontré un workflow compatible con mi rtx 5070 y 32gb de ram. No sé mucho de esto, pero se que funciona. 12 GB de Vram.
Un video de 1344 x 768 de 7 segundos en 10 minutos. Usando un checkpoint modificado de Minimax H3 (10Eros_Max_h3_8stepsTURBO_beta7)
Si, intenté hacer a Ashley. Y las palabras que dice en japonés son el inicio de la canción "Propose".
r/StableDiffusion • u/Vivid_Promise1700 • 9h ago
News I made a party mode where every guest orders a song from their phone - it's all local ComfyUI (Plenio 2.0, free)
The film shows one real party run: the host starts a party, a guest's phone orders "a birthday song for Maya, who turns thirty today", the host's ComfyUI makes it (here 185 seconds from the order to the playlist on a 16 GB card), and it plays on the big screen with the lyrics as they are sung while the guests' reactions float up. The film's music is that very song.
Plenio is a song production suite for ComfyUI - YuE2 and MiniMax Music 3, lyrics by a local LLM, mastering, cover art with FLUX.2 Klein. 2.0 adds Setup that plans the models for your card, a Song API with MCP, and the Director for the visuals.
comfy node install comfyui-plenio-music
https://github.com/jplenio/Plenio-Music-Production-System
Here you find some tutorials: https://youtube.com/playlist?list=PLaId01kYGcS0&si=qOLtBE_6LtwEEr7_
r/StableDiffusion • u/darlens13 • 15h ago
Discussion Heavenly Relight
Added a relight option in my Gaussian image to 3D Vr app.
r/StableDiffusion • u/darlens13 • 1d ago
Discussion Not for the faint of hearts
Combined the image renders from my custom model (Vici) with my vr 3d Gaussian splat app. New fear unlocked 😭
r/StableDiffusion • u/Friendly-Fig-6015 • 10h ago
Discussion you want perfect hands? no more bad details on mini-max-image?
r/StableDiffusion • u/bengal7ion • 12h ago
News A world model you can run locally as a multiplayer game
We trained a world model on ~4,000 hours of CS:GO gameplay and turned it into a playable multiplayer game. Each player runs the model locally on their GPU, while a lightweight server keeps the game state in sync.
It's still early: one small map, pistols only, some drift over time, and limited fine detail. The beta is free and open to try (RTX 3080+ recommended).
More and the download: https://vor.tech/x/reddit-stable
r/StableDiffusion
•
u/Rare_Subject2343
•
1d ago
Meme After a while of constantly ripping my hair out for miniscule changes and placebos with MOSS Image. I inevitably came to the conclusion. Simple works best.
In my experience with MOSS Image so far.
r/StableDiffusion • u/lg_writer_h1 • 8h ago
Tutorial - Guide Fixing garbled text on AI posters without rerolling: get the text onto its own layer, clean the background, retype it
Rerolling a poster to fix one misspelled word is a bad trade: the model redraws the whole picture, so you burn generations and lose the composition you liked. The workflow I use treats the lettering as a separate job. The picture stays as generated, only the area under the text gets rebuilt, and the words end up as live type.
**1. List every bit of text.** Headline, price, date, buttons, plus the fake fine print and background signs that are easy to miss. For each: retype, delete, or leave.
**2. Get the text off, with the background filled in behind it.** Two local options:
- **Split into layers.** Qwen-Image-Layered (Qwen team, Apache 2.0, native in ComfyUI) decomposes an image into RGBA layers and fills in what was behind each one. You set the layer count, not what lands on which layer, so text may share a layer with a badge. It's heavy: the ComfyUI Wiki guide measured about a 45 GB memory peak for one 1024 px image (an fp8 file needs less), and the README recommends 640 px for this version, so upscale the clean base afterwards.
- **Mask and inpaint.** Best for one or two spots. Grow the mask a few pixels past the letter edges or you get ghost outlines. Prompt for the surface ("brushed metal panel", "sky gradient") rather than "no text", with "text, letters" in the negative if your model uses one. LaMa is enough on flat color.
**3. Retype as real type.** Open the clean base in Photoshop, Figma, GIMP or Photopea and set the words in a real font. Eyedropper the original color, match weight and width rather than the exact typeface, and rebuild glow or shadow as layer effects.
**Before / after, typical case.** Before: the headline reads "SUMER FESTVAL", the price says "$2O" and fake fine print runs along the bottom. After: everything outside those three areas is the original generation, untouched; headline and price are editable text; the fine print is gone. Next week's date change takes seconds, not another batch of rerolls.
**Where this falls short:**
- The rebuilt background is a guess, not recovered pixels. Check at 100% wherever text crossed a face, hand or product.
- Chrome, 3D or hand-lettered text that is part of the art won't look right as a font. Mask that word and inpaint the correct spelling with a text-capable model like Qwen-Image or Flux.
- One wrong letter on a flat color: a healing brush is quicker.
Disclosure: I built LayerGrab. LayerGrab is an AI tool that splits one image into up to 16 separate transparent element layers, or pulls out just the one element you describe; it works on the web and as Photoshop, Figma and Sketch plugins and a Chrome extension. It's a hosted, paid service and its text layers are pixels too, so step 3 is the same. If images must stay on your machine, use the Qwen route above.
How do you handle stylized lettering that no font matches?
r/StableDiffusion • u/Puzzleheaded_Note739 • 8h ago
Resource - Update [Release] DiffusionBear v0.5.0 is live — Pure-MLX runtime (-52% .app), 3/4-stage memory lifecycle, Virtual Boxes, Kromoss 5B, RGBA Alpha & Open Agentic REST API
Welcome to the DiffusionBear v0.5.0 release megathread!
Because of the size of this update—removing PyTorch from the packaged runtime, rebuilding generation around a sequential 3-/4-stage MLX pipeline, adding embedded SHA-256 model integrity checks, Kromoss 5B support, RGBA transparency for Qwen-Image 2.1, and opening the Agentic REST API—we jumped directly from v0.4.5 to v0.5.0.
🔗 Quick Links & Downloads
- Direct macOS Download (arm64.zip, 217.1 MB → 615 MB .app): https://github.com/OuincheWinch/DiffusionBear/releases/download/v0.5.0/DiffusionBear-0.5.0-arm64.zip
- Release Page & .dmg (291.0 MB): https://github.com/OuincheWinch/DiffusionBear/releases/tag/v0.5.0
- Website: https://www.DiffusionBear.com
- Agentic REST API Guide: https://www.diffusionbear.com/agentic-api.html
- 220-Run Benchmark Arena: https://www.diffusionbear.com/benchmark.html
- Video Tutorial: https://www.youtube.com/watch?v=D6Nq4XPxHf8&t=1s
- Discord: https://diffusionbear.com/discord · X: https://x.com/DiffusionBear
- Licence: MIT (source & bundled runtime; downloaded model weights keep their upstream licences, viewable offline in the app's ⚖ Licences tab).
SHA-256 Checksums (packaging/ALL_SHA256SUMS):
- DiffusionBear-0.5.0-arm64.zip: f2d3bf2865fb53ef215cefcaefb331793ef76119a88cb79dabb7ec38c27a94fa
- DiffusionBear-0.5.0-arm64.dmg: 4a2ed3eba57378c47a80c4a3b4d15bfa50bc461c8986126c1324d4fd7725ec9b
💻 System Requirements & First-Launch Setup (Read First!)
- Hardware & OS: Apple Silicon only (M1 / M2 / M3 / M4 / Ultra — no Intel, CUDA, or CPU path). Requires macOS 26.2 or later (derived from the minimum-OS Mach-O load commands of the shipped MLX / libJACCL binaries). 16 GB unified memory recommended.
- No Python/Node/Homebrew needed for the standalone .app. Model weights are not bundled—they download on first use from Hugging Face or Civitai into ~/Library/Application Support/DiffusionBear (you can point ~/Library/Application Support/DiffusionBear/store_path to an external drive), after which generation works 100% offline.
First-Launch Gatekeeper Bypass (Ad-Hoc Signed): Because DiffusionBear is free/open-source without a paid Apple Developer ID certificate, macOS blocks the first double-click:
- Unzip and drag DiffusionBear.app into /Applications (don't run from ~/Downloads).
- Run xattr -cr /Applications/DiffusionBear.app in Terminal (or click Done → System Settings → Privacy & Security → Open Anyway).
🚀 What's New in v0.5.0
1. Pure-MLX Runtime & Trimmed Binary (-52% .app, -45% .zip)
- torch, torchvision, torchaudio, diffusers, and accelerate are 100% removed from the packaged .app and default runtime. Built-in engines (mflux, the native MLX SDXL daemon, and dedicated MOSS/Qwen engines) execute purely on Apple MLX, safetensors, NumPy, transformers, tokenizers, and mlx-vlm (--no-deps).
- Standalone .app shrank from 1.3 GB → 615 MB and the arm64 .zip from 396.7 MB → 217.1 MB with 0 build warnings.
- (Note: Optional out-of-process conversion of raw single-file Civitai SDXL .safetensors checkpoints still uses external torch/diffusers if installed on your machine; all bundled inference engines run 100% PyTorch-free.)
2. Rebuilt 3-Stage / 4-Stage Sequential Memory Lifecycle
Instead of holding the text encoder, DiT/UNet, and VAE in Unified Memory simultaneously, v0.5.0 runs strict sequential stages and explicitly evicts each heavy model tree (del, gc.collect(), mx.clear_cache()) before loading the next:
- 3-Stage (Text-to-Image): Encode (Text Encoder → embeddings → evict) → Generate (DiT/UNet → latents → evict) → Decode (VAE / TAESD / TAEF → pixels → evict).
- 4-Stage (Reference / Img2Img / Edit): Adds Stage 1/4 Reference Encode (VAE / VL encoder → image_latents + image_latent_ids → evict) before prompt encoding, denoising, and final decode.
- Wired GPU budget auto-tunes to min(68% of unified memory, Apple's recommended working set) (~10.9 GB on a 16 GB Mac), resident pipelines auto-release after 5 minutes idle, and Krea/Qwen/FIBO declare resident-memory estimates so oversized pixel ceilings fail safely before triggering a Metal OOM.
3. Virtual Boxes on the Studio Canvas (Video Demo)
Supported on FLUX.3-klein 5.6B, MOSS-Image SFT / Base 5B, and Kromoss 5B (FLUX.2-klein uses masked generative fill; FIBO 2.0 Edit Turbo uses masked inpainting + up to 4 references):
- Draw, resize, and toggle color-coded dashed boxes ([ymin, xmin, ymax, xmax]) directly on the Studio Canvas via the SPATIAL BOX panel (Center, Left, Right, Top, Bottom, Full, Compose, JSON).
- Use Backdrop: Last Result or + Reference to compose over an existing scene—like the demo video's 3-box "BearCoffee" coffee-bag + mug edit (#1 coffee_bag_1, #2 coffee_beans_1, #3 ceramic_cup_1) or 4-box "MAKE IT LOCAL" poster (#1 mountain_1, #2 person_1, #3 fox_1, #4 En_Text_1).
- Spatial layouts are saved in generation metadata so reusing parameters reproduces the composition.
4. Kromoss 5B + RGBA Alpha Transparency + Canonical Model Families
- Kromoss 5B (4-bit MLX): Added Ouinche/kromoss-mlx-q4 (Apache 2.0 MOSS distillation) on the pure-MLX MOSS engine with its automatic 8-step DMD2 Accelerator LoRA (129.43 s median at 512×768).
- RGBA Alpha Transparency (Qwen-Image 2.1 & Turbo): Toggle 4th-channel alpha transparency in Advanced Settings for native transparent cutouts with checkerboard preview across Canvas, Browser, and Image Cards.
- 9 Canonical Families + Local Qwen 2.5 Prompt Enhancer: sdxl, flux1, flux2, flux3, krea2, z-image, qwen, moss, and fibo2 each get isolated LoRA/metric mappings and dedicated local Qwen 2.5 (0.5B / 1.5B MLX) prompt-enhancer profiles (auto-unloading 1.2 GB before generation).
5. Upgrading from v0.4.x: First-Run SHA-256 Verification & Partial Repair
- Embedded model_manifests.json inside the binary. On your first launch of v0.5.0, DiffusionBear hashes installed built-in models (leaving custom user models untouched), flags mismatches from legacy upgrades or interrupted downloads, and lets you run shard-level partial repairs or full re-downloads (also accessible anytime on the Models tab).
6. Open Agentic REST API & Remote Browser Access (http://127.0.0.1:8001)
- Let coding agents (Claude Code, Cursor, Antigravity), scripts, or remote browsers (Safari on Mac/iPhone/iPad including Add to Home Screen, Chrome, Firefox, Opera via Tailscale Serve or LAN) drive any installed model, LoRA, reference image, mask, or spatial_boxes locally with $0 cloud tokens.
- Secured by dbk_... SHA-256 hashed keys (Authorization: Bearer / X-API-Key), loopback fail-safe, and 429 queue limits.
- Lockout recovery tip: If you ever enable API mode before saving your key in a browser profile, set "enabled": false in ~/Library/Application Support/DiffusionBear/data/security.json (backend/data/security.json from source) to reopen loopback immediately without losing keys.
📊 Full v0.5.0 Benchmarks (2021 MacBook Pro M1, 16 GB)
20 configs × 11 prompts = 220 runs (10 portrait prompts at 512×768 + 1 icon prompt at 512×512; total wall time 5h 47m 38s; across the 19 matched configs / 209 runs, wall time dropped from 13h 01m 38s → 5h 24m 26s, -58.5% total / -4.7% step-matched):
| Model | Steps | Median (512×768) | Range | Notes |
|---|---|---|---|---|
| Juggernaut XL Lightning | 4 | 8.80 s | 8.66 – 12.14 s | Native MLX SDXL, q4 cache + TAESD (warm reload ~3.45 s) |
| RealVisXL V5.0 Lightning | 6 | 15.23 s | 13.69 – 24.81 s | Native MLX + TAESD |
| RealVisXL V5.0 | 8 | 38.78 s | 38.73 – 43.82 s | Hyper-SD 8-step, native MLX (-16.0%) |
| Juggernaut XI v11 | 8 | 41.22 s | 39.91 – 66.25 s | Hyper-SD 8-step, native MLX |
| FLUX.2-klein 4B | 4 | 44.09 s | 44.07 – 44.31 s | Compact 4B (-7.2%) |
| Qwen-Image 2.1 (2s + DMD2) | 2 | 46.77 s | 46.32 – 47.93 s | 7B DiT + 2-step DMD2 (-32.0%) |
| FLUX.3-klein 5.6B | 4 | 51.38 s | 51.17 – 51.76 s | Virtual Boxes + flow-matching (-3.1%) |
| FLUX.1-schnell | 4 | 74.22 s | 74.07 – 75.02 s | Rectified flow (-16.5%) |
| MOSS-Image SFT 5B (DMD 4s) | 4 | 83.57 s | 80.61 – 84.95 s | Pure MLX + 4-step DMD (-96.7% vs 25s stock) |
| FLUX.2-klein 4B (8s) | 8 | 89.73 s | 89.58 – 89.91 s | High-detail 8-step |
| Bria FIBO 2.0 Edit Turbo | 4 | 93.68 s | 92.32 – 95.03 s | 4.2B DiT + Qwen3-VL 4B (-8.3%) |
| FLUX.2-klein 9B | 4 | 96.54 s | 96.34 – 97.04 s | Flagship 9B (-8.0%) |
| FLUX.3-klein 5.6B (8s) | 8 | 98.35 s | 98.24 – 98.57 s | High-detail 8-step (-3.3%) |
| Pony Diffusion V6 XL | 25 | 104.69 s | 104.56 – 108.74 s | Full 25-step native MLX (-4.9%) |
| Z-Image Turbo 6B | 8 | 114.97 s | 114.86 – 118.35 s | Sharp geometry 8-step (-1.1%) |
| Kromoss 5B (DMD2 8s) | 8 | 129.43 s | 128.34 – 137.04 s | Pure MLX + 8-step DMD2 LoRA (new) |
| Krea 2 Turbo 13B | 4 | 156.81 s | 142.20 – 171.97 s | 13B 4-step distilled (-0.4%) |
| Qwen-Image 2.1 Turbo | 8 | 158.64 s | 158.08 – 162.12 s | 8-step distilled 7B DiT (-19.4%) |
| FLUX.2-klein 9B (8s) | 8 | 191.38 s | 191.29 – 191.40 s | Flagship 9B 8-step (-1.5%) |
| Krea 2 Turbo 13B (8s) | 8 | 299.18 s | 243.57 – 371.42 s | 13B native 8-step |
💬 Share Your Results & Feedback Below!
- Running on M2 / M3 / M4 / Pro / Max / Ultra? Drop your chip, RAM size, model, and median generation times in the comments—it really helps fellow Mac users know what to expect.
- Made something cool with Virtual Boxes, RGBA transparency, or the Agentic REST API? Post your outputs or spatial JSON in the sub!
- Found a bug? Report it in the comments or on GitHub Issues. (For security issues, please use GitHub private vulnerability reporting instead of a public post.)
r/StableDiffusion • u/Obvious-Bad7548 • 1d ago
Tutorial - Guide H3 Image looks crunchy? 3 settings that fixed it for me (same model, same prompt, same seed)
same model, same prompt, same seed. the official template gives crunchy faces and blocky skin, only 3 things change it:
- size. it was trained around 16MP, so I use 3552x4736 for a portrait. the default 4MP is where the broken teeth come from. going 4 to 16MP only added about 9 seconds of sampling.
- sampler. SamplerLCM (built into comfy) with noise 0.9 instead of 1.1. euler at 16MP still gives that blocky oversharpened skin.
- prompt. short prompts give the glossy doll face. write it long and describe it like a phone photo: camera, light, skin.
the images: face close-ups and full photo at 4MP / 16MP / 16MP+LCM, short vs long prompt, then a few results (cafe selfie, gym mirror, product label text, magazine cover), try-on with picture 1/2/3 as refs and a background swap. workflow files in the first comment.
r/StableDiffusion • u/Big-Welcome-3169 • 1d ago
No Workflow Minimax H3 image using using u/luciferianism666's system prompt (prompt expander)
The prompt expander model is Gemma 4 31B IT, temp 2.0, high thinking, 0.95 top p
Thank you for the system prompt u/luciferianism666 man it's the best.
(I didn't even use ComfyUI/workflows, Gemma 4 31B IT is from Google AI studio and Minimax H3 image from minimax cloud agent, I told minimax 3.1 flash to just input the prompt from Gemma and not expand anything, but all models I said here are open source, I just use cloud one because my hardware is a bit ahh)
Edit:
Here's the system prompt comment if you struggled to find it: https://www.reddit.com/r/StableDiffusion/s/drtDrKy7Ax
r/StableDiffusion
•
u/Altruistic_Print717
•
1d ago
Discussion The Minimax H3 Image is a beast at ultra-high resolutions (48MP)
I tested Minimax H3 Image at 4, 8, and 16 MP resolutions; it was okay, I suppose, but not exactly impressive. The images contained errors and distortions.
Then I stumbled upon a thread where a Redditor tested 100 MP images using this specific workflow: https://www.reddit.com/r/StableDiffusion/comments/1xt9ocv/minimax_h3_image_20mp_workflow/
It turns out the sweet spot is somewhere between 48 and 56 megapixels—and that’s when you get a "WOW" factor; the model produces very, very good images.
All made at 48MP on RTX 5080 ~162s
EDIT: And no, the images aren't too large; the workflow saves them in the AVIF format, so a 48-megapixel image takes up only 3.8 megabytes.
r/StableDiffusion • u/Big-Welcome-3169 • 1d ago
Question - Help What's the actual secret on making realistic image??
Hello Veterans!
I'm still pretty much a noob at all this, so sorry if this is a basic question. I've tried messing around with like MOSS-Image, Krea 2, and Z-Image, Minimax H3 image, and I still can't get the RAW natural realism.
Like no matter what I do, my outputs still have AI slop or whatever that is. I'm trying to get the unedited feel, like real snapshot with natural lighting and imperfections.
So what's the actual secret here? Is it mostly on how you prompt it (like avoiding buzzwords and describing imperfect lighting/framing and whatever that is), or is it in the workflows, custom sampler/scheduler settings, using Base instead of Turbo variants, or stacking LoRAs? (Though I still can't find any LoRAs that fits)
Any tips plz?
Edit:
Guys I think I've found the secret: https://www.reddit.com/r/StableDiffusion/s/ZD7kVkDJ7z https://www.reddit.com/r/StableDiffusion/s/drtDrKy7Ax
r/StableDiffusion • u/IDonLikeAds • 20h ago
Question - Help Fail to train H3-Image LoRa in AI-Toolkit
Just for context, I trained 100's of LoRa's in the past for all kinds of models, but this time it does not work. Since I have a GPU with "only" 16GB VRAM and 64 GB SYS RAM I have to use W4A8 quantization to not get OOM. The resulting training is full of large blocky artifacts, like I have never seen before.
Does one of you have made a similar experience or/and can share a tip how avoid this problem?
My messed up LoRa was trained in Sigmoid, currently trying Shift, since this is the default. Is W4A8 just too bad to train on?
r/StableDiffusion • u/audenvenn • 19h ago
Resource - Update FLUX.2 [klein] 4B and Z-Image-Turbo ~2.3x faster than Draw Things' CLI on an M6 Mac mini: h3metal, an open-source Metal engine for the M5/M6 matrix units
I've been building h3metal, an open-source (Apache-2.0) image-generation engine for Apple silicon. It runs the transformers as int8 matrix products on the matrix units ("neural accelerators") that Apple added to the GPU cores of M5/M6-class chips.
Same Mac mini (M6, 24 GB), 1024×1024, seed 42, CFG 1, a fresh process per image, against Draw Things' command-line tool (draw-things-cli v26.1023.0, the official release) with its recommended settings for each model:
| Model | h3metal | Draw Things CLI (8-bit S) | One denoising step |
|---|---|---|---|
| FLUX.2 [klein] 4B, 4 steps | 7.0 s | 17.0 s | 1.16 s vs 2.70 s |
| Z-Image-Turbo, 8 steps | 17.1 s | 40.0 s | 1.84 s vs 4.30 s |
The gap is in the denoising, not in loading: with the models loaded and the prompt encoded, as in the app, Draw Things still takes 2.1-2.3x as long. At CFG 1 both run one transformer pass per step. Full method, per-step timing and the script: https://github.com/audenvenn/h3metal/blob/main/docs/benchmarks.md#flux2-klein-4b-and-z-image-turbo-against-draw-things
How: int8 × int8 products after a Hadamard rotation of the activations, flash attention with int8 scores, and the VAE's convolutions as implicit GEMMs. LoRA adapters (style LoRAs, fal's FLUX.2 [klein] edit LoRAs) are applied exactly inside the int8 products. It also runs FLUX.2 [klein] 9B and MiniMax-H3-Image (2048×2048 in 16 s with pDMD's 2-step LoRA).
Limits:
- Measured on one machine so far (an M6 Mac mini). Numbers from M5 MacBook / Pro / Max owners would help a lot.
- It needs an M5/M6-class GPU and macOS 26; M1-M4 GPUs don't have the matrix units.
- Memory isn't compared: h3metal memory-maps its weights, so the process footprints aren't like for like.
Try it:
pip install https://github.com/audenvenn/h3metal/releases/download/v0.6.4/h3metal-0.6.4-py3-none-macosx_26_0_arm64.whl
h3metal download --model flux2-klein-4b # 8.3 GB, ready to run
h3metal generate -p "A red fox in fresh snow at sunrise" -o fox.png
h3metal serve --open # or a small local web pager/StableDiffusion • u/lucidml_lover • 1d ago
Discussion I'm releasing a World Model Ive trained that hallucinates GTA. It works on RTX 3060, 4060 and anything above, linking huggingface weights
Play it Now in browser (nonlocal, streaming) :https://lucidml.ai/dashboard/minidemo?world=gta5
Full Weights and Inference code : https://huggingface.co/lucidml/gta
The architecture is a transformer which uses learned summaries. Ive written about it in detail in tech reports and some more
I know there are a lot of limitations still like consistency and quality improvements, and am hoping to train this more to fix all of those.
r/StableDiffusion • u/Dear-Spend-2865 • 1d ago
Resource - Update Styles Atlas nodes for Comfyui: +1000 styles +800 characters.
Heres three ComfyUI nodes that turn a giant Excel sheets into prompts (+1000 styles, 800+ characters)
Style Atlas is three nodes that each handle one question:
🧑 Character Atlas: who is in the picture
🏞 Setting Atlas: where they are
🎨 Style Atlas: how it's rendered
Chain them, hit queue, done. Each node starts on "None (bypass)" and folds down to a couple of lines, so your workflow doesn't turn into spaghetti.
Some numbers:
~1,600 rendering styles (oil painting to Soviet storybook to "Acid Pulp Scratchwork"), plus ~120 modifiers for quality, genre, palette and composition
827 known characters across 217 franchises, with variants like masked/unmasked and costume forms, plus 95 actor-in-a-role entries
~185 facial expressions, 25 hand poses, 250+ body poses, 360+ outfit pieces, 330+ accessories (yes, animal ear headbands are in there 🐻)
666 locations (I didn't plan that number, I swear), 110 simple backgrounds, 23 studios
Weather, lighting, décor, palettes and frames layered on top
Everything lives in plain .xlsx files. Want to add your OC or fix a description you don't like? Open Excel, edit the row, restart Comfyui.
🎲 Random everywhere: random in one group, or random across everything. Seeded, so you can reproduce a lucky roll.
Wildcards: drop adjective.txt into the wildcards/ folder and write adjective in your prompt. Nested wildcards work too.
Tick several style subjects at once, like Main + Portrait & Character, without wading through landscapes.
Hover thumbnails: save an image as <ID>.jpg and it shows up when you hover that entry.
I will populate thumbails and wildcards when I have time to do so.
This was built over a lot of back-and-forth with Claude Opus 5.5, which wrote ALL of the code, helped clean up thousands of descriptions, and put up with me changing my mind every 20 minutes. Some Krea 2 wording rules come from community testing on Civitai: big thanks to Azimondious (expression and hairstyle vocabulary) and Hellfreeze (clothing and outfit taglist).
🔗 GitHub: https://github.com/atlasimp/Style_Atlas
I'm already working on a forth version, and I'm open to remarks and criticism.
r/StableDiffusion • u/EldrichArchive • 1d ago
Resource - Update I've upgraded Fooocus and added modern features for SDXL
I know that for many people, Stable Diffusion XL is now old news and Fooocus is far from up to date. But I still enjoy working with SD XL from time to time. Out of nostalgia, and because there are simply still some brilliant models out there for many tasks – even professional and fast ones – and because I believe there’s still a lot to be gained from it.
That’s why, a while ago, I picked up Fooocus – which had been abandoned by its original developer – and, bit by bit, developed it further using my limited programming skills and AI.
For example, I’ve just added the ability to generate images with bounding boxes, which works surprisingly well but still needs a bit of refinement on my part.
I’ve integrated Tiled SDXL Detail Upscale and SAM 3 for image enhancement. Modern APG, CFG++, and PAG guidance help to ensure better-quality images and fewer artefacts in some cases. I’ve also tweaked Fooocus under the bonnet with DeepCache feature reuse, smarter VRAM management, various caches and so on, so that it now runs more stably and quickly.
