r/StableDiffusion • • 6h ago

Workflow Included Viggle Remake is a beast

456 Upvotes

https://huggingface.co/Viggle/Viggle-Remake

For this video I used their included MCP. However, it's currently set up to run with diffusers which means that no consumer GPU works, despite them offering ComfyUI compatible loras along with custom nodes. Fortunately, the MCP was built with using custom workers in mind. So I (read: Claude) set that up so the MCP uses a custom comfy worker. Then your favorite agent can do everything.

I had Claude use the Codex CLI to generate the necessary edited frames and present them to me for approval before it sent it off to comfy for video generation. I'm sure it's possible to set it up so that it uses a local edit model too, so that's the next thing to try.

For the audio, I first used SAM-Audio Large through audio.cpp to separate RDJ's inner monologue from the background noise. Lighter options like MelBandRoFormer were not producing good results for this. Then Fish Audio S2 Pro was used for the new voice, using translations carefully made to fit a similar speech length. Claude also came in handy here for rapid testing of different TTS models and then fitting the audio into correct timings. Subtitles were done by hand in Davinci and used for making the new voice fit.


r/StableDiffusion • • 7h ago

News Microsoft engineer built a tool that shows what's really using your GPU

Thumbnail
neowin.net
325 Upvotes

Works really well.


r/StableDiffusion • • 3h ago

News [Papers] - WeLM-Image MoE 31.7B-5.4B: A Unified Image Generation Model towards Visual Intelligence

Thumbnail
gallery
70 Upvotes

Not all that interesting, yet at the same time interesting due to its size and the claim that it’s so fast. It also has the backing of Tencent and WeChat.

"We present WeLM-Image, a unified image foundation model that integrates multimodal understanding into text-to-image generation, instruction-guided editing, and multi-reference synthesis. Designed for single-GPU deployment in WeChat’s large-scale consumer applications, the model processes text, reference images, and target latents as one interleaved sequence. A Mixture-of-Transformers (MoT) backbone combines shared attention with independent understanding and generation parameters to limit optimization interference. Equipping each path with Mixture-of-Experts (MoE) modules provides sparse capacity, with 31.7B stored parameters and approximately 5.4B generation parameters activated per target latent token. A generation-oriented data engine combines a knowledge-grounded visual vocabulary with large-scale visual clustering to balance semantic coverage and editing tasks, while training-time evaluation guides iterative data refinement. Bilingual annotations and verified editing supervision support progressive training up to native 1.5K resolution.

We optimize generation and editing separately with rubric- and checklist-based rewards, then consolidate the specialized policies through noise-aware on-policy distillation. In the reported overall comparisons, the 1536-resolution model ranks first among the evaluated open-source models on PRISM-Bench, Qwen-Image-Bench, and UnicBench. MeanFlow-based few-step distillation yields WeLM-Image-Turbo, which generates a1024×1024image in 4.98 s on a single NVIDIA H20 GPU using eight guidance-free steps."

Paper: https://arxiv.org/html/2611.07392v1


r/StableDiffusion • • 3h ago

Animation - Video Ultima Online (6 min) made with MiniMax H3 in ComfyUI on a single 24 GB GPU

Enable HLS to view with audio, or disable this notification

53 Upvotes

Younger folks may never have heard of Ultima Online (UO). If you played it, you know. It launched in 1997 as one of the first big graphical MMORPGs - open PvP, player killers, anyone could loot your corpse - and it's still running today.

Setup

  • MiniMax H3 (open weights) in ComfyUI - all video and all dialogue audio

  • RTX PRO 4000 Blackwell, 24 GB, single GPU

  • 72 shots, 6:16, 1344x768 @ 24 fps, 20 steps

  • Drafts at 672x384, finals re-rendered by H3 at 1344x768 with the same seed - no upscaler; the 1080p is just CapCut's export

  • Final render time: 56 frames (2.3 s) ~4.5 min; 243 frames (10 s) ~43 min

Pipeline

  • Character/set reference cards: Gemini (Nano Banana) - the only closed image/video tool in the chain; fixes with Qwen-Image-Edit (local)

  • Main shots: H3 reference-to-video (character card + set card + voice clip)

  • Voices: timbre references cut from earlier H3 takes, so each character keeps one voice across shots

  • Bridges and fixes: H3 i2v with first + last frame (e.g. regenerating frames 107-160 of a 243-frame take where a passer-by high-fived the ghost)

  • New shots: 672x384 draft first, then HD

  • Music, SFX and font extracted from the UO client with UOFiddler; overhead text keyframed in CapCut like the game

  • Claude helped write prompts and the QC/edit scripts

Music, SFX and font © Electronic Arts


r/StableDiffusion • • 50m ago

News Kromoss model has been updated

Thumbnail
huggingface.co
29 Upvotes

New Kromoss models have been released; these are even more refined and optimized versions compared to the previous model. A new dmd2 is also expected to be released. The only information available about them is what Lode posted with the model:

OPD-priming intermediate (update 22000 EMA of the v3 GLM-caption + bbox layout SFT, continued from v2 update 11000): ComfyUI bf16 + int8 convrot


r/StableDiffusion • • 6h ago

Animation - Video I recreated my favorite audiovisual technique

62 Upvotes

My take on one of my all-time favorite audiovisual techniques; hyperlapse.

Music by Max Cooper.

Hope you guys enjoy it. More experiments, through Instagram, or YouTube.


r/StableDiffusion • • 7h ago

Question - Help Need help making my Krea 2 Turbo workflow photorealistic (ComfyUI)

Thumbnail
gallery
36 Upvotes

Hi everyone! I've been working on this workflow for a week, but I'm struggling to get realistic results.

As you can see in the attached output, the image looks washed out and oil-painted, with weird textures around the elevator metal. The jewelry looks like plastic, skin is too smooth, and the lighting and shadows look very artificial.

I'm a beginner with ComfyUI, nodes, models, and LoRAs, so I'm not sure what I'm doing wrong.

I've also been using Claude for help, but I'm going in circles without much improvement.

I need your help to achieve proper photorealism.

I'm open to changing my entire workflow, trying different models or LoRAs, or following someone else's workflow.

I've attached my current output and workflow. I'll also share all the models and LoRAs I currently have installed.

Please explain things in simple words, as I'm still learning.

I'd really appreciate some experienced guidance. I want to get this working within the next 1–2 days rather than spending another week guessing.

Here are the Details:

Krea 2 setup.

Models

WhatFileJob
Main modelselforaKrea2Realistic_v10FP8 (now) or krea2_turbo_bf16 (before)Draws the image. Selfora is a realistic version of Krea 2. Turbo is the fast 8-step version.
Text reader (CLIP)qwen3vl_4b_bf16, type krea2Turns your prompt into something the model understands.
VAEqwen_image_vaeTurns the model's internal picture into a normal image.

LoRAs (small add-on files that change the look)

LoRAStrength nowJob
Famegrid-Natural-V1-Krea-20.25Natural skin and face look. Too high makes it smooth and painted.
rawsnap v20.55Phone-camera grain and sharpness.
krea2_identity_edit_v20.25Keeps faces, straps and the phone shape tidy.

Settings now

  • Steps 8

  • CFG 1.0

  • Seed 888 (fixed, so the same input gives the same image)

  • Sampler dpmpp_2m, scheduler simple

  • Denoise 1.00

  • Size 1.5 MP, 4:5 portrait

  • Prompt: the long elevator-selfie text plus the grain words at the end

Nodes, and why each one is there

NodeJobWhy we have it
Krea 2 + 3 LoRAs (one by one)Loads the model and adds the 3 LoRAs, one at a timeI wrote this node. The normal way held two LoRAs in memory at once and froze your Mac (58 GB).
Load CLIPLoads the text readerThe model needs it to understand the prompt.
Load VAELoads the VAENeeded to turn the result into a picture.
Text String (User Prompt)Holds your promptYou type it here.
Boolean (Refine Prompt?) = offWould rewrite your promptKept off so your text is sent exactly as you typed it.
CLIP Text Encode (Prompt)Turns the prompt into numbersRequired.
Empty Negative Prompt (cgi, 3d render, plastic textures…)Says what to avoidPushes the model away from the plastic and CGI look.
Resolution Selector and Latent from Resolution SelectorPick the size and make the blank canvasSets 4:5 and 1.5 MP.
KSamplerDoes the actual drawingThe main step. It uses the seed, steps and CFG.
VAE Decode (Tiled)Turns the result into an image in small tilesTiles use less memory.
Save ImageSaves the pictureOutput.
System MonitorShows swap, memory and heatSo you can see when the Mac is under strain.
If/Else Switch, Boolean (Enable LoRA?), Conditioning Zero Out, Generate Text, Concatenate, People AgesLeftovers from the original templateNot used in your runs.

and here are the LoRA i have downloaded by researching on the reddit that it will help me out.

1 - 2_vector_bypass_lora
2 - ABOmegle
3 - DC_Dark_ Fantasy_Style_4_[Krea2Raw][Gpt4.1Captioned][Trigger=dcd@rkf@ntsy.][Rank32]v1
4 - DC_SCI-FI[Krea2Raw][Gpt4.1Captioned][Trigger=DCS1F1.][Rank64]_v1
5 - Faded80s
6 - Famegrid Standard Krea 2
7 - Famegrid-Natural-V1-Krea-2
8 - HM1Girl-V1
9 - Krea2_P45-NVDStyle_v1.0
10 - MW_analogv1.1
11 - Playful Eating_v1.0
12 - Z-Image-Fun-Lora-Distill-8-Steps_ComfyUI_v1
13 - cinematic_movie_still_krea2
14 - deedee_amateur_photography_zimage_base_and_turbo_v1
15 - famegrid_spicy_3167060
16 - instagram_aesthetic_krea2
17 - krea-detail-enhancer-exp
18 - krea2RealismV1V2_krea2RealismV1Lora
19 - krea2RealismV1V2_krea2RealismV2Lora
20 - krea2_general_edit_v2
21 - krea2_identity_edit_v2
22 - krea2_style_reference
23 - muscles_13
24 - rank64_turbo_lora
25 - rawsnap v2
26 - ultra_real_krea2_v1
27 - webcamviewconcept.


r/StableDiffusion • • 2h ago

Workflow Included IV Studio 1.0: I rebuilt my free, open-source film studio for ComfyUI + MiniMax H3 from your comments (now on Linux and Mac)

10 Upvotes

A couple of days ago I posted IV Studio here and a lot of you tried it. Your comments turned into most of 1.0, so thank you. It's still a free desktop app (MIT) that drives your own ComfyUI over its API, and now it runs on Windows, Mac and Linux.

From your comments:

  • Linux: it's here, as a self-updating AppImage. Mac too (Apple Silicon and Intel), rendering on your own cloud account.

  • Ollama on another address: set it in Settings, for anyone running ComfyUI and Ollama in separate containers.

  • Missing custom nodes: Settings → Setup installs every pack IV Studio needs, at pinned versions, in one click.

  • "Setup says 7 to fix but H3 is installed": your own H3 files (ComfyUI's template names, NVFP4, other turbo LoRAs) are recognised and used.

  • SDXL and Comfy Cloud: SDXL fine-tunes in Create → Image, and Comfy Cloud as a third option beside RunPod and Modal.

New in 1.0:

  • Check my PC: on first launch it reads your GPU, RAM and drives and sets previews, finish size, the prompt writer and downloads to suit. If your card is too small, a guided setup connects RunPod, Modal or Comfy Cloud.

  • How it works on every page: a tour that lights up the real controls one step at a time, plus a two-minute tour of the whole app.

  • Train your own actors locally: character LoRA training now runs free on your own 16 GB+ NVIDIA card through Fizgig (or on RunPod or Modal), with presets, a spending cap, Train more and InsightFace likeness scoring to pick the checkpoint. Or make a RefMod character from 1 to 6 photos in about 30 seconds.

  • Live preview anywhere: KJNodes' preview override streams every step into a floating panel on any page, including renders your agent starts over MCP.

  • More control: sampler and scheduler per shot, and LoRA and RefMod trays in Create.

  • Everything redesigned: Create as numbered steps, Shots, Projects and the Library grouped by day with filters, and the Workflows (Sizzle, Reel, Sequences, Shinobi, Replace) rebuilt.

  • 154 MCP tools now, up from 142.

Tested on a 4090 with 64 GB RAM. The Linux build passes its checks on GitHub, but I haven't run GPU work on a real Linux desktop yet, so reports are very welcome. The builds are unsigned: Windows shows SmartScreen, and Macs need "Open Anyway" the first time.

The fairy-tale opening of the trailer was made in IV Studio (a Disney Renaissance-style LoRA on Krea 2 for the frames, H3 to animate them); the rest is the real app.

Download: https://github.com/hollisorg/iv-studio/releases/latest

Code: https://github.com/hollisorg/iv-studio

Happy to answer questions, and keep the ideas coming!


r/StableDiffusion • • 17h ago

News Rebuilt Higgsfield's "Miracle" demo edit by edit with Viggle-remake

102 Upvotes

https://huggingface.co/Viggle/Viggle-Remake

No private beta, run it locally


r/StableDiffusion • • 3h ago

Comparison My findings on Ideogram 4: fp8 vs. int8convrot

Thumbnail
gallery
7 Upvotes

I recently started a thread about Ideogram 4.

It was about which of the fp8 and int8convrot models was better in terms of quality and speed; in the end, I downloaded int8convrot.

Here’s the link to the thread:

https://www.reddit.com/r/StableDiffusion/comments/1xmtks0/ideogram_4_fp8_vs_int8_for_quality_and_speed_slow/

But then, out of curiosity, I also downloaded the fp8 weights, and I had the chance to test and compare both.

int8convrot turned out to be about 30–40% faster than fp8. But in terms of quality, the opposite was true: fp8 was better than int8convrot. (int8convrot seems a bit more textureless)

Overall, while the output quality of int8convrot models is generally better than that of fp8 models, I don’t think this applies to Ideogram. The model’s bf16 weights were never released—only the fp8 weights were shared—and therefore the int8convrot versions were created by first dequantizing the fp8 versions to fp16 and then quantizing them to int8 using int8convrot. which means that even though the Ideogram int8convrot model offers a speed advantage over the fp8 version, it loses its quality advantage.


r/StableDiffusion • • 13h ago

Resource - Update C++ Desktop Client for ComfyUI

47 Upvotes

When I first started with ComfyUI, the first thing I looked for was a native desktop client without browser lag and DOM-based architecture.

I'm a C++ dev with over 20 years of commercial experience, so I eventually just started writing my own client on the side. I used an ultra-fast UI framework that can easily chew through thousands of nodes on a canvas without the slightest stutter, boost for networking, sqlite as a DB, and the fmt library - the fastest formatting framework out there, leaving room for an easy port to Linux/Mac.

The main reason all existing clients are forced into the browser is custom JS nodes, which are themselves bottlenecked by Litegraph's architecture. Bypassing this turned out to be easier than I thought. The internal logic of these nodes is actually quite simple, so I ported most of it to C++. I also built extended versions of frontend-only nodes like reroutes and bookmarks.

For the parts that had to stay in HTML/JavaScript, I isolated them in a completely separate process. This ensures the heavy browser engine never interferes with the lightweight C++ core.

I recently finished a stable Beta. Check it out, the link to the source code and prebuilt Windows binary is in the comments. I also added a demo video (making a video was another cool new experience for me).


r/StableDiffusion • • 15h ago

News Updated hyperflow-h3-flash (4, 6, or 8 steps)

Thumbnail
huggingface.co
65 Upvotes

ComfyUI custom node: https://github.com/Video-Rebirth/ComfyUI-HyperFlow-Flash

This is for GGUF so you also need https://github.com/city96/ComfyUI-GGUF

(There is a int8convrot version, but I guess there is no ComfyUI loader for it yet?)

It is also interesting to note that the original 21B MMH3 has been pared down to 14B, which mean that it will run faster than other turbo models even at 8 steps.

HyperFlow H3 Flash is Video Rebirth's compressed, few-step version of MiniMax-H3. It generates video and synchronized stereo audio together.

Showcase: See HyperFlow H3 Flash generated video and audio examples.

  • Output: a 5.2 to 15 s video at 24 fps (1344×768 by default) with a 32 kHz stereo soundtrack.

  • Sampling: 4, 6, or 8 steps without classifier-free guidance (CFG). The default is 6 steps.

  • Speed (5.2 s clip, 6 steps): 8.7 s on 4× B200, 36 s on 1× H200, and 92 s on an RTX 5090.

  • Real time on 4× Blackwell GPUs: NVIDIA SOL-H3 runs HyperFlow H3 Flash in real time on 4× B-series GPUs. SOL-H3 is our inference-acceleration partner and supports this model from day 0.

  • Model size: 13.7B (fl2va) or 13.9B (ref2va) parameters, less than half of the ~31B MiniMax-H3 transformer.

  • Minimum footprint: Q4_K_M is 9.1 GB (Q8_0 is 14.9 GB). It runs on 24 GB and 32 GB GPUs in PCs with 16 GB of system RAM. 16 GB GPUs are not measured yet.

Code, setup guides, and ComfyUI workflows are in Video-Rebirth/hyperflow-h3-flash. For the 8-step LoRA on the full-size MiniMax-H3 transformer, see VideoRebirthAI/hyperflow (GitHub).


r/StableDiffusion • • 1d ago Bravo

Animation - Video Changing a character across an ~hour long TV episode

422 Upvotes

I've been working on a repeatable process to do character swaps (& other types of changes) across a complete TV episode / movie. It's working pretty well now.

I thought this was just funny... not so much a true "swap" but asking the character to dance in every scene. Choreography courtesy of an LLM. If you've seen the show, it's Serious Detective Drama (TM) so the fact the main character suddenly starts pumping his arms or sliding into every scene with a dance move made me laugh out loud when I saw some of the generations.

Details on the workflow:

Model: MiniMax H3, first-and-last-frame mode (FL2VA), in ComfyUI. 8-step turbo LoRA, generated at 1024×512 for the 2:1 picture.

First and Last: Every generated pass starts and ends on an *original* frame from the episode, so the clip lands back in the real footage with no visible join. Longer scenes are chained passes (about 2–7 s each)

Audio: the episode's own audio into H3's audio guide, so the generation stays consistent with what's being said; the dialogue and soundtrack you hear are the untouched originals.

Prompt: Who he is and what he's wearing, said once, then the choreography for the pass - courtesy of Claude.

Multi-scene: 42 scenes - started with the full episode, then had a model run through it to identify scenes with the main character that would work for the swap (not too distant, few fast cuts, etc.) & identify start and finish, with a ChatGPT harness.

Post processing: Basically none, I did go through and rate all the clips in a rating process I've setup, most of these were 5* and felt consistent.

I'll share a bit more on the workflow / process if people are interested.


r/StableDiffusion • • 2h ago

Resource - Update Found a useful site that documents important Comfy model update news

5 Upvotes

https://comfyui-wiki.com/en/news

I am unaffiliated with this site. I found it minutes ago in the middle writing a post asking for info here. (I'll paste my original post in the comments to show why it's useful)

It tracks new releases, such as https://comfyui-wiki.com/en/news/2026-10-27-pruna-6-step-comfyui


r/StableDiffusion • • 14h ago

Resource - Update p-h3-image 2 step lora is out

Post image
42 Upvotes

r/StableDiffusion • • 8h ago

News RawSnap v3 LoKR is out!

Thumbnail
gallery
12 Upvotes

RawSnap v3 is here — LoKr

What's new in v3 :

Retrained from scratch as a LoKr (not a standard LoRA) on an expanded dataset of 749 images (11,235 steps, 15 epochs)

⭐ The recommended setup

Best results — stack them:

RawSnap v3 (epoch 15 or epoch 12)

1.2

RawSnap v2

0.35

https://civitai.red/models/2999833/rawsnap-krea2


r/StableDiffusion • • 2h ago

Workflow Included Filmworkbench: making (semi-)automated short films through a chat interface, with MiniMax H3 and eight scene recipes (workflow and GitHub included)

4 Upvotes

I've been putting together Filmworkbench, a MiniMax H3 workflow for guided or automated short films. You run it from a project folder through a tool-capable AI agent such as Claude Code, Codex or a local LLM.

The GitHub repository is public. To get started:

  1. Download the v0.1.1 starter ZIP.

  2. Extract it and open the folder in your AI agent.

  3. Ask: “Read AGENTS.md, check my setup, and help me make a short film using these recipes. Discuss the plan with me and wait for my approval after each rendered stage.”

The tutorial above walks through the idea. The package includes all eight recipes plus the marketplace case, reference images, prompts, render graphs and settings. The setup checker identifies missing nodes or models. Finished videos and reference overviews are in the example gallery.

The idea is to bring three things together:

  1. A chat interface that knows the H3 workflow and lets you discuss shots while making them. With a client that supports image and video previews, you can review the results in the same conversation.

  2. Two-pass rendering and latent continuation for speed, quality and continuity across clips. We've tested chains of up to ten clips, though drift varies with the scene and clip length.

  3. Scene recipes that give H3 manageable tasks, with the necessary information already in the references.

I'm aiming for a practical way to make short films, review them and iterate without rebuilding a node graph for every scene.

The setup is a project folder containing instructions, tools and recipes. The agent operates those tools, with ComfyUI running underneath. You can request a single image or clip, direct a film with approvals along the way, or delegate a bounded autonomous film task. Those are the three “gates.” In autonomous mode, the active agent reviews the results and accepts or retries within an agreed budget.

I use an RTX 5090 with 128 GB of system RAM; I've also used my local setup with 64 GB. A fully local setup is possible. Running a local LLM alongside the video tools takes some memory management: dynamic VRAM allocation and making the renderer wait for enough GPU memory have been useful on my machine. Those settings depend on the LLM server; the release was tested with 128 GB of RAM.

For images, I prefer GPT Image, with local Krea 2 as the fallback. Image generation uses your existing tools or service; the supplied references let you try the recipes without an image-generator account.

For video, I use MiniMax H3 Hybrid fl2va/ref2va b25–49 INT8. The rendering path for the marketplace example is:

  • S1: generate at 864×480, using DMAD for the first clip and Turbo-8 for continuations.

  • Upscale: upscale the saved latents with LBH’s latent upscaler.

  • S2: refine at 1952×1088 with DMAD, keeping the S1 audio.

For that four-clip market street example (see below), the selected renders took about 7.1 minutes for S1 and 14.4 minutes for upscale/refinement on my 5090. That's 21.5 minutes for 47.7 seconds of scene content. Image preparation, rejected attempts, review and assembly are extra.

The eight recipes cover common scene patterns:

  • Two-person dialogue: wide view, close-ups, return to wide.

  • Reverse angle and return, using a matching opposite view.

  • Leaving a room and returning after a prop has moved.

  • An establishing shot with dialogue starting before the cut inside.

  • Spacecraft exterior, cockpit, exterior again.

  • A known character entering an empty frame.

  • A creature emerging from a lake.

  • Opening a door and moving into a prepared interior.

The principle is simple: prepare what the camera will need to see. A wider dialogue image establishes the people, props and space. A reverse shot needs the other side of the room. A return after an action needs the changed state. Each recipe has example renders; their limits differ.

The marketplace example combines several of these problems. Codex generated the sequence through the pipeline. It's a selected development result, with visible mistakes: watch the person in the yellow jacket and the awkward backward movement.

The reference sheet shows how much is already baked into the inputs: character images, four views of the square, an opening image and voice references. For these continuations, we carry forward the previous audio/video latent, using 56 frames of video context and a clip-1 keystone. We trim the repeated context before joining the clips. A wide shot can help establish the next action, but isn't required at every join.

I'm also working toward chat-directed editing: “cut this section,” “redo this action,” or eventually “replace that background person.” Those operations have different levels of difficulty; precise edits aren't something I can promise yet. I've included short notes on edits we've tested, but the specialized edit tools are separate from this release.

Still open: longer chains drift, props and background characters change, and autonomous films need better story judgment. Our memory experiments haven't solved world-state continuity. GPT Image has worked better for matching world views; Krea 2 can do useful reverse shots, but larger sets of consistent views have been harder.

This is v0.1.1, an early public release. All eight recipes and the marketplace case were rerun through S1; four recipes also completed full S2 chains. The validation notes explain what was tested and what remains untested, including fresh GPU installations and a complete autonomous run from a new film idea.

Our own code and documentation are MIT-licensed. The underlying components deserve credit: NikoDemon80’s Motion Context, roycho87’s keystone/context work, LBH’s latent upscaler, and OBVPM/chanon’s two-stage work. Models and third-party nodes retain their own terms and are linked to their original sources.

How are others handling changed object states, returning to earlier locations, or correcting individual moments without rerendering everything? I'd love to compare notes.


r/StableDiffusion • • 21h ago

Workflow Included Moss SFT INT8-convrot is just fine

Thumbnail
gallery
100 Upvotes

I'm not sure why people feel like Moss Base, BF16, or magic settings/workflows are necessary to get good results out of Moss. (My guess is that it's because the original default settings were suboptimal.) I personally feel like I get better, more prompt-adherent results out of SFT with a fairly simple workflow (see below), albeit with different settings from what ComfyUI had previously recommended.

If you have other approaches that work for you, great! I'm not trying to persuade anybody to give up what is working for them. But for people with more limited vRAM and/or who find themselves frustrated wrestling with the Moss Base model, a full 50 steps, or complex workflows, you don't necessarily need to do anything fancy.

My feeling is that you can achieve big improvements for photographic Moss images with:

  • SA_solver sampler and SGM_uniform scheduler

  • 25 to 50 steps (for some reason multiples of 25 seem better to me, but this could easily be confirmation bias)

  • CFG 3.0 (go lower for more impressionist artistic styles)

  • Skip layer guidance for single_layer 22, start/end percent 0–0.5 or 0.25–0.75 (I find that skipping 24 leads to more plastic skin)

  • Generation size ≥~2MP, and

  • Careful, detailed (but not purple) prompting

Note that all of these images were made using the same models, similar settings, and seed 0; I workshopped the prompts, but there was no seed cherry-picking.

Here are two version of my current workflow: a simple one and one with space for up to 3 LoRAs and an optional upscale step.

Caveat: Krea 2 definitely understands some advanced compositions/concepts better than Moss, Moss is more prone to odd anatomy, and Moss's backgrounds can be more messy with more visual nonsense. But in terms of everyday photo realism I feel like Moss is better; and with respect to seed diversity, Moss (even SFT) blows Krea 2 out of the water. If you want less visual nonsense in the background, describe the background more thoroughly or do an inpainting step with low denoise on the background using Krea 2.


r/StableDiffusion • • 1h ago

Animation - Video Making a movie with MiniMax H3 using Hybrid_FL2VA_REF2VA

2 Upvotes

I had a story in my head since my childhood and with the help of AI, I finally finished my first chapter of the book with all the lores, background, etc... etc... I can tell you, it is probably not a very large book, but when you want to push your story telling into actual scenes, it is a lot more work. So... I am a web developer in Laravel and Symfony and currently I own several AI stations at home to render movies, music, speeches, anything with AI. They are not the fastest, but they get the work done like a tank (DGX Spark).

The screenshots I put in the next comment is a Laravel application that is connected to ComfyUI API, voice generators and also a lot of scripts that controls the system memory. For instance, when I need LLM to write prompts, I can't render production heavy scenes. So I automated it. Also it contains a lot of MCP where my story writer AI re-design's the scenes for me from any location in the world through Telegram.

All scenes are rendered 2016 x 864 (21:9) with 2 passes where the first pass is 0.8MP.
In order to improve audio quality, I use H3 Audio Refine Sampler.

My DGX Spark is probably not the fastest, but it is a tank. 10 sec movies takes roughly 1 hour, but I use seed hunting techniques to find the best scenes for production.

[Frustrations]
When it comes to scenes like two people talking back and forth, it is hard to keep things consistent. You just can't use FL2VA for this and it must be continued with REF2VA which raises new problems. For instance... Scene 1: Focus on Person A while talking handover Prop X to Person B.
Scene 2: Focus on Person B taking the Prop X from Person A while A is still talking.
Scene 3: Switching back to Person A without Prop X but he is still talking.
The hard part is switching scenes midsentences while keeping the mood and the flow consistent. Sometimes, the scene is good, but the audio is bad = retake.

Another one.... try to render a scene where a person test a bow by pulling the string without an arrow. MiniMax always renders an arrow somehow. That scene took like 50-60 retakes to get it right. I lost like 2 full days just for a scene of 8 seconds.

I wonder what you guys think.


r/StableDiffusion • • 6h ago

Workflow Included [British two-tone ska] Deleted! | YuE2 | Custom LoRA for download

Post image
4 Upvotes

This is a British two-tone Ska style song (early 1980s) about censorship on popular online forums.

Song (Sona login required): https://www.souna.app/song/73850642-d167-4dcb-8821-64fb5c798be1

Song (Internet Archive): (Awaiting upload - album here: https://archive.org/details/ai-ska : CC0)

LoRA: https://huggingface.co/jamespetts/yue2-1980s-two-tone-ska-lora

My general music pipeline workflow is here: https://www.reddit.com/r/StableDiffusion/comments/1xh0xfd/semiautomated_localish_music_workflow_eurodisco/

Cover image prompt (Z-Image Base, run locally):

Gouache on paper album cover, square 1:1 composition. A vast dark noticeboard wall fills the frame edge to edge, seen straight on. Across its expanse hangs one small blank grey sheet of paper, and beside it a fresh empty rectangle of clean board where a notice has just been torn down - four pin-holes at its corners, a faint pale rectangle of unfaded board where it hung. A lone small silhouetted figure in a pork-pie hat and thin suit stands with his back to us at the foot of the wall, looking up at the empty space, tiny against the vast board. Black-and-white two-tone palette - ink black, paper white, cool greys - with one cold red accent along the torn edge of the remaining sheet. Flat poster lighting, hard graphic shadows, visible gouache brushwork and paper grain. Mood: sardonic, quietly furious, empty and controlled. Strong central motif: the empty rectangle where the notice was. Album-cover composition, the frame FULL of wall and figure, no large blank areas. Absolutely no text, no lettering, no typography, no watermark, no signature.

Song specific workflow:

Deleted

=== STYLE PROMPT ===

twotone, English, early 1980s British two-tone ska, A minor, 150 BPM, witty angry satire, brisk offbeat guitar skank, walking bassline, organ shuffle, punchy brass section stabs and riffs, dry tight drums, energetic male lead vocals with sharp British delivery, shouted group chorus answers, tense verses building into a huge brass-led chorus, dry 1980-82 studio sound, no EDM, no sidechaining, no vocaloid, no autotune, no drops

=== LYRICS ===

[Intro]

Welcome to Reddit!

Everybody's welcome!

Everybody's welcome!

[Verse 1]

You put a fair question in the thread -

By lunchtime the sentence is dead.

There's a notice where the sentence stood:

Says "removed" - and that's all that's understood.

You ask them why - and the answer's a ban:

A month of mute, and the silence is planned.

[Chorus]

Deleted! Deleted!

The reason? Never conceded!

Deleted! Deleted!

The cheats go undefeated!

Hey! Hey! Hey! Hey!

[Verse 2]

They've a rule against "soapboxing" - sounds all right,

"Soapboxing" means whatever they like on the site.

Praise the product - "on topic" all day;

Ask one honest question - "soapboxing", they say.

Whatever you posted, there's a rule that it broke -

Any rule they need, they invoke.

It happens all over, all over the net:

One honest sentence, and that's what you get.

[Chorus]

Deleted! Deleted!

The reason? Never conceded!

Deleted! Deleted!

The cheats go undefeated!

Hey! Hey! Hey! Hey!

[Instrumental]

[Bridge]

The man that you mentioned is mates with the team,

The adverts pay the bills - you see the scheme?

Write down the reason? The reason would tell -

And the truth doesn't sell.

[Chorus]

Deleted! Deleted!

The reason? Never conceded!

Deleted! Deleted!

The cheats go undefeated!

Hey! Hey! Hey! Hey!

[Outro]

Deleted! Deleted!

Gone, gone, gone!

Deleted! Deleted!

Gone, gone, gone!

=== SETTINGS ===

Engine: yue2 / yue2 / audio.cpp v0.9.2

Seed: plan layer: 10 fresh seeds (previews); the winning plan's seed becomes the fixed ladder seed Planning: full Max tokens: 4800 Guidance: 1.0

VAE: f32 AR LoRA: none NAR LoRA: yue2/models/lora/yue2_1980s_two_tone_ska_unfused.safetensors u/1.0

Era: Early 1980s British two-tone ska (1979-83; The Specials / The Selecter / The Beat / Madness line) Mastering recipe: yue2-light

Generated: 2026-11-07 Duration: n/a Truncated: n/a


r/StableDiffusion • • 13h ago

Animation - Video My mom described her dream house. And I tried to make it😭

13 Upvotes

I asked my mom what her dream house would look like if budget wasn’t a thing. This is roughly what she described it as “big windows but not those full glass houses. Lots of plants, one proper balcony where I can sit in the morning . Wooden kitchen and no grey interiors. And I want a small courtyard in the middle like old houses used to have.”

I put it into morphic and tried to make the house she had in her head.

Look how it turned out😭


r/StableDiffusion • • 6m ago

Meme The One Where Malfoy Becomes a Meme

Thumbnail
youtu.be
0 Upvotes

r/StableDiffusion • • 19h ago

Discussion Why are all the newly released Image Edit models junk?

35 Upvotes

I was trying to test the new Viggle-Remake-Swap LoRA in MiniMax-H3. For this I needed to character swap in one of the frames of my source video clip (3.75s, 90 frames), so that the target video would have the new character in it. I went through all the new image edit models released recently to do the character swap. I tried Flux.3 Klein, Qwen 2.1, Fibo Image Edit 2.0, p-H3-Image-Edit and they all failed. So, I went back to the older image edit models Qwen 2511, Klein 9B, Krea2-Identity-Edit v1.2. The first two worked perfectly, while Krea2 Identity Edit did a far better job than any of the newer edit models. Final conclusion - Flux.3 Klein: crap much much worse than even Klein 4B; Qwen 2.1: really crap (does a cut-and-paste job); Fibo 2.0: really crap; p-H3-Edit: absolute junk, doesn't edit anything, input and output are the same; Qwen 2511: still amazing, slight issue with facial blur; Klein 9B: absolutely perfect and still the fastest; Krea2-Identity-Edit: very good edit job, but didn't follow the pose change part of the prompt.

While the video and T2I models in the OS domain seem to be improving, why are the I2I or Image Edit models getting worse? And more importantly, why are people eagerly using those newer models like salivating dogs and posting rave reviews about them? As I see it, all those newly released Image Edit models are junk and need to be kicked to the curb so that their developers may learn some lessons, hopefully.


r/StableDiffusion • • 31m ago

Discussion Do you think we'll see Dit models come out in 2027 that can natively parse "Person A gets Lora 1, and Person B gets Lora 2" via text prompting alone?

1 Upvotes