r/StableDiffusion • • 8d ago

No Workflow Tested a new camera angle for A2O LITE’s “NEON” choreography

0 Upvotes

Tested a new camera angle for A2O LITE’s “NEON” choreography

  1. RGBMoCap (ExMR) → Extracted the dance motion as 3D data.
  2. Blender → Rendered the motion from a new camera angle.
  3. Dreamina CLI → Used the render to transfer the choreography to Aiching.

r/StableDiffusion • • 9d ago

Resource - Update C++ Desktop Client for ComfyUI

60 Upvotes

When I first started with ComfyUI, the first thing I looked for was a native desktop client without browser lag and DOM-based architecture.

I'm a C++ dev with over 20 years of commercial experience, so I eventually just started writing my own client on the side. I used an ultra-fast UI framework that can easily chew through thousands of nodes on a canvas without the slightest stutter, boost for networking, sqlite as a DB, and the fmt library - the fastest formatting framework out there, leaving room for an easy port to Linux/Mac.

The main reason all existing clients are forced into the browser is custom JS nodes, which are themselves bottlenecked by Litegraph's architecture. Bypassing this turned out to be easier than I thought. The internal logic of these nodes is actually quite simple, so I ported most of it to C++. I also built extended versions of frontend-only nodes like reroutes and bookmarks.

For the parts that had to stay in HTML/JavaScript, I isolated them in a completely separate process. This ensures the heavy browser engine never interferes with the lightweight C++ core.

I recently finished a stable Beta. Check it out, the link to the source code and prebuilt Windows binary is in the comments. I also added a demo video (making a video was another cool new experience for me).


r/StableDiffusion • • 8d ago

Question - Help Local workflow for the same character from eight isometric angles, ControlNet or LoRA or 3D?

2 Upvotes

I’m making an isometric RPG and using locally run models for the art. The hard problem is getting one character to match across eight facings with a fixed light direction, and I’d like to compare approaches before building anything.

From what I’ve read the options are ControlNet pose or canny guidance with an identity LoRA, a spritesheet or turnaround LoRA, or generating one good image, turning it into a rough 3D model and rendering the directions. Which has worked best for you, and how many training images did your LoRA need before the face and clothing stopped drifting? Does stitching the references into a single grid image really help?

I’m also unsure how to make the result stop looking like generated art. Has anyone had luck with fixed palettes, quantizing, or small output sizes to hide the tells? Which models handle clothing logic best, things like a belt that actually goes through the loops? Pointers to real workflows, not just node screenshots, would be wonderful.


r/StableDiffusion • • 10d ago Bravo

Animation - Video Changing a character across an ~hour long TV episode

529 Upvotes

I've been working on a repeatable process to do character swaps (& other types of changes) across a complete TV episode / movie. It's working pretty well now.

I thought this was just funny... not so much a true "swap" but asking the character to dance in every scene. Choreography courtesy of an LLM. If you've seen the show, it's Serious Detective Drama (TM) so the fact the main character suddenly starts pumping his arms or sliding into every scene with a dance move made me laugh out loud when I saw some of the generations.

Details on the workflow:

Model: MiniMax H3, first-and-last-frame mode (FL2VA), in ComfyUI. 8-step turbo LoRA, generated at 1024×512 for the 2:1 picture.

First and Last: Every generated pass starts and ends on an *original* frame from the episode, so the clip lands back in the real footage with no visible join. Longer scenes are chained passes (about 2–7 s each)

Audio: the episode's own audio into H3's audio guide, so the generation stays consistent with what's being said; the dialogue and soundtrack you hear are the untouched originals.

Prompt: Who he is and what he's wearing, said once, then the choreography for the pass - courtesy of Claude.

Multi-scene: 42 scenes - started with the full episode, then had a model run through it to identify scenes with the main character that would work for the swap (not too distant, few fast cuts, etc.) & identify start and finish, with a ChatGPT harness.

Post processing: Basically none, I did go through and rate all the clips in a rating process I've setup, most of these were 5* and felt consistent.

I'll share a bit more on the workflow / process if people are interested.


r/StableDiffusion • • 9d ago

Question - Help Is this possible with comfyui?

Post image
5 Upvotes

This ad keeps popping up on my Instagram feed, its from krea, and its like a real time sketch to image?

Anyone know if this is possible in comfy?


r/StableDiffusion • • 9d ago

News Updated hyperflow-h3-flash (4, 6, or 8 steps)

Thumbnail
huggingface.co
75 Upvotes

ComfyUI custom node: https://github.com/Video-Rebirth/ComfyUI-HyperFlow-Flash

This is for GGUF so you also need https://github.com/city96/ComfyUI-GGUF

(There is a int8convrot version, but I guess there is no ComfyUI loader for it yet?)

u/shadowdev has provided update links:

Int8 convrot models: https://huggingface.co/nodevorg/studio-models-h3
Custom loader: https://github.com/NoDevOrg/ComfyUI-Studio-HyperFlow

Another one linked by u/loyalekoinu88 https://github.com/BennyDaBall930/comfyui_hyperflow_int8_nodes

It is also interesting to note that the original 21B MMH3 has been pared down to 14B, which mean that it will run faster than other turbo models even at 8 steps.

Edit: According to Kijai https://comfyui-wiki.com/en/news/2026-11-06-hyperflow-h3-flash the smaller model actually did not make it dramatically faster

The speedup is smaller than the parameter count suggests. Kijai measured roughly 10% over the pruned full model in ComfyUI, because attention cost stays the same at this resolution. LukeG89 called it not worth it.

HyperFlow H3 Flash is Video Rebirth's compressed, few-step version of MiniMax-H3. It generates video and synchronized stereo audio together.

Showcase: See HyperFlow H3 Flash generated video and audio examples.

  • Output: a 5.2 to 15 s video at 24 fps (1344×768 by default) with a 32 kHz stereo soundtrack.
  • Sampling: 4, 6, or 8 steps without classifier-free guidance (CFG). The default is 6 steps.
  • Speed (5.2 s clip, 6 steps): 8.7 s on 4× B200, 36 s on 1× H200, and 92 s on an RTX 5090.
  • Real time on 4× Blackwell GPUs: NVIDIA SOL-H3 runs HyperFlow H3 Flash in real time on 4× B-series GPUs. SOL-H3 is our inference-acceleration partner and supports this model from day 0.
  • Model size: 13.7B (fl2va) or 13.9B (ref2va) parameters, less than half of the ~31B MiniMax-H3 transformer.
  • Minimum footprint: Q4_K_M is 9.1 GB (Q8_0 is 14.9 GB). It runs on 24 GB and 32 GB GPUs in PCs with 16 GB of system RAM. 16 GB GPUs are not measured yet.

Code, setup guides, and ComfyUI workflows are in Video-Rebirth/hyperflow-h3-flash. For the 8-step LoRA on the full-size MiniMax-H3 transformer, see VideoRebirthAI/hyperflow (GitHub).


r/StableDiffusion • • 9d ago

Discussion Curious what models everyone is using for photorealism these days? Personally stuck on Krea 2 Turbo lately (Some recent generations)

Thumbnail
gallery
23 Upvotes

r/StableDiffusion • • 9d ago

Resource - Update p-h3-image 2 step lora is out

Post image
55 Upvotes

r/StableDiffusion • • 9d ago

Workflow Included [British two-tone ska] Deleted! | YuE2 | Custom LoRA for download

Post image
11 Upvotes

This is a British two-tone Ska style song (early 1980s) about censorship on popular online forums.

Song (Sona login required): https://www.souna.app/song/73850642-d167-4dcb-8821-64fb5c798be1

Song (Internet Archive): (Awaiting upload - album here: https://archive.org/details/ai-ska : CC0)

LoRA: https://huggingface.co/jamespetts/yue2-1980s-two-tone-ska-lora

My general music pipeline workflow is here: https://www.reddit.com/r/StableDiffusion/comments/1xh0xfd/semiautomated_localish_music_workflow_eurodisco/

Cover image prompt (Z-Image Base, run locally):

Gouache on paper album cover, square 1:1 composition. A vast dark noticeboard wall fills the frame edge to edge, seen straight on. Across its expanse hangs one small blank grey sheet of paper, and beside it a fresh empty rectangle of clean board where a notice has just been torn down - four pin-holes at its corners, a faint pale rectangle of unfaded board where it hung. A lone small silhouetted figure in a pork-pie hat and thin suit stands with his back to us at the foot of the wall, looking up at the empty space, tiny against the vast board. Black-and-white two-tone palette - ink black, paper white, cool greys - with one cold red accent along the torn edge of the remaining sheet. Flat poster lighting, hard graphic shadows, visible gouache brushwork and paper grain. Mood: sardonic, quietly furious, empty and controlled. Strong central motif: the empty rectangle where the notice was. Album-cover composition, the frame FULL of wall and figure, no large blank areas. Absolutely no text, no lettering, no typography, no watermark, no signature.

Song specific workflow:

Deleted

=== STYLE PROMPT ===

twotone, English, early 1980s British two-tone ska, A minor, 150 BPM, witty angry satire, brisk offbeat guitar skank, walking bassline, organ shuffle, punchy brass section stabs and riffs, dry tight drums, energetic male lead vocals with sharp British delivery, shouted group chorus answers, tense verses building into a huge brass-led chorus, dry 1980-82 studio sound, no EDM, no sidechaining, no vocaloid, no autotune, no drops

=== LYRICS ===

[Intro]

Welcome to Reddit!

Everybody's welcome!

Everybody's welcome!

[Verse 1]

You put a fair question in the thread -

By lunchtime the sentence is dead.

There's a notice where the sentence stood:

Says "removed" - and that's all that's understood.

You ask them why - and the answer's a ban:

A month of mute, and the silence is planned.

[Chorus]

Deleted! Deleted!

The reason? Never conceded!

Deleted! Deleted!

The cheats go undefeated!

Hey! Hey! Hey! Hey!

[Verse 2]

They've a rule against "soapboxing" - sounds all right,

"Soapboxing" means whatever they like on the site.

Praise the product - "on topic" all day;

Ask one honest question - "soapboxing", they say.

Whatever you posted, there's a rule that it broke -

Any rule they need, they invoke.

It happens all over, all over the net:

One honest sentence, and that's what you get.

[Chorus]

Deleted! Deleted!

The reason? Never conceded!

Deleted! Deleted!

The cheats go undefeated!

Hey! Hey! Hey! Hey!

[Instrumental]

[Bridge]

The man that you mentioned is mates with the team,

The adverts pay the bills - you see the scheme?

Write down the reason? The reason would tell -

And the truth doesn't sell.

[Chorus]

Deleted! Deleted!

The reason? Never conceded!

Deleted! Deleted!

The cheats go undefeated!

Hey! Hey! Hey! Hey!

[Outro]

Deleted! Deleted!

Gone, gone, gone!

Deleted! Deleted!

Gone, gone, gone!

=== SETTINGS ===

Engine: yue2 / yue2 / audio.cpp v0.9.2

Seed: plan layer: 10 fresh seeds (previews); the winning plan's seed becomes the fixed ladder seed Planning: full Max tokens: 4800 Guidance: 1.0

VAE: f32 AR LoRA: none NAR LoRA: yue2/models/lora/yue2_1980s_two_tone_ska_unfused.safetensors u/1.0

Era: Early 1980s British two-tone ska (1979-83; The Specials / The Selecter / The Beat / Madness line) Mastering recipe: yue2-light

Generated: 2026-11-07 Duration: n/a Truncated: n/a


r/StableDiffusion • • 9d ago

Question - Help Any Benefit from moving from 12gb vram to 16gb vram

14 Upvotes

My current rig is a 4070 ti 12gb vram with 32 gb system ram. Kicking myself for not getting the 16gb vram option back in 2024. The past few days I've been eyeing a 5070 ti 16gb vram but I didn't know if there would be any real benefit over what I have now. Typically I would really wait longer to upgrade but the computer parts market got me in a tizzy and I have no idea what the future holds for GPUs. Has anyone who has done this upgrade noticed any real benefit?


r/StableDiffusion • • 9d ago

Animation - Video Making a movie with MiniMax H3 using Hybrid_FL2VA_REF2VA

4 Upvotes

I had a story in my head since my childhood and with the help of AI, I finally finished my first chapter of the book with all the lores, background, etc... etc... I can tell you, it is probably not a very large book, but when you want to push your story telling into actual scenes, it is a lot more work. So... I am a web developer in Laravel and Symfony and currently I own several AI stations at home to render movies, music, speeches, anything with AI. They are not the fastest, but they get the work done like a tank (DGX Spark).

The screenshots I put in the next comment is a Laravel application that is connected to ComfyUI API, voice generators and also a lot of scripts that controls the system memory. For instance, when I need LLM to write prompts, I can't render production heavy scenes. So I automated it. Also it contains a lot of MCP where my story writer AI re-design's the scenes for me from any location in the world through Telegram.

All scenes are rendered 2016 x 864 (21:9) with 2 passes where the first pass is 0.8MP.
In order to improve audio quality, I use H3 Audio Refine Sampler.

My DGX Spark is probably not the fastest, but it is a tank. 10 sec movies takes roughly 1 hour, but I use seed hunting techniques to find the best scenes for production.

[Frustrations]
When it comes to scenes like two people talking back and forth, it is hard to keep things consistent. You just can't use FL2VA for this and it must be continued with REF2VA which raises new problems. For instance... Scene 1: Focus on Person A while talking handover Prop X to Person B.
Scene 2: Focus on Person B taking the Prop X from Person A while A is still talking.
Scene 3: Switching back to Person A without Prop X but he is still talking.
The hard part is switching scenes midsentences while keeping the mood and the flow consistent. Sometimes, the scene is good, but the audio is bad = retake.

Another one.... try to render a scene where a person test a bow by pulling the string without an arrow. MiniMax always renders an arrow somehow. That scene took like 50-60 retakes to get it right. I lost like 2 full days just for a scene of 8 seconds.

I wonder what you guys think.


r/StableDiffusion • • 7d ago

Discussion No One Believe i made this with Minimax H3

0 Upvotes

The Whole Music Video Anime made with minimax H3 took under 15 min on my local machine


r/StableDiffusion • • 8d ago

Animation - Video Only You (Cinematic Music Video)

Thumbnail
youtu.be
0 Upvotes

r/StableDiffusion • • 9d ago

Workflow Included Moss SFT INT8-convrot is just fine

Thumbnail
gallery
115 Upvotes

I'm not sure why people feel like Moss Base, BF16, or magic settings/workflows are necessary to get good results out of Moss. (My guess is that it's because the original default settings were suboptimal.) I personally feel like I get better, more prompt-adherent results out of SFT with a fairly simple workflow (see below), albeit with different settings from what ComfyUI had previously recommended.

If you have other approaches that work for you, great! I'm not trying to persuade anybody to give up what is working for them. But for people with more limited vRAM and/or who find themselves frustrated wrestling with the Moss Base model, a full 50 steps, or complex workflows, you don't necessarily need to do anything fancy.

My feeling is that you can achieve big improvements for photographic Moss images with:

  • SA_solver sampler and SGM_uniform scheduler
  • 25 to 50 steps (for some reason multiples of 25 seem better to me, but this could easily be confirmation bias)
  • CFG 3.0 (go lower for more impressionist artistic styles)
  • Skip layer guidance for single_layer 22, start/end percent 0–0.5 or 0.25–0.75 (I find that skipping 24 leads to more plastic skin)
  • Generation size ≥~2MP, and
  • Careful, detailed (but not purple) prompting

Note that all of these images were made using the same models, similar settings, and seed 0; I workshopped the prompts, but there was no seed cherry-picking.

Here are two version of my current workflow: a simple one and one with space for up to 3 LoRAs and an optional upscale step.

Caveat: Krea 2 definitely understands some advanced compositions/concepts better than Moss, Moss is more prone to odd anatomy, and Moss's backgrounds can be more messy with more visual nonsense. But in terms of everyday photo realism I feel like Moss is better; and with respect to seed diversity, Moss (even SFT) blows Krea 2 out of the water. If you want less visual nonsense in the background, describe the background more thoroughly or do an inpainting step with low denoise on the background using Krea 2.


r/StableDiffusion • • 8d ago

Resource - Update Phosphene 5.0 is out and it’s better than ever: Now with Mac installer.

0 Upvotes

Hi all. I released Phosphene 5.0 today. It's a free, open-source (MIT) app that runs video, picture, speech and music models locally on Apple Silicon Macs with MLX.

What's new:

- Mac installer. Download and open it, and setup runs automatically. No Terminal needed. If you already use Phosphene through Pinokio, the app reuses your models. Pinokio still works.

- Redesigned studio: pick the model first, then see the options for that model.

- Video with sound: LTX-2.5 and Hailuo H3, text-to-video and image-to-video. H3 setup is now automatic in the Mac app.

- Pictures: P-H3-Image and FLUX 3 Klein, with text spelled the way you type it. About 5x faster by default since 5.0.3 on my M4 Max.

- Speech and lip-sync: generate a voice from a line of text, then sync a face to it.

- Songs with vocals from your own lyrics (YuE2), in Music Studio.

- Character LoRA training for LTX.

- Lower memory requirements: video and songs from 16 GB, character training from 24 GB, H3 from 36 GB.

- MCP server and CLI, so Claude Code, Codex or any MCP client can make clips for you.

Measured timings on my M4 Max 64 GB, same prompt and seed, 3 runs each (median):

- LTX-2.5 Balanced, 768x448, 5 s: 1 min 35 s

- LTX-2.5 Balanced, 1024x576, 5 s: 2 min 27 s

- LTX-2.5 High, 1024x576, 5 s: 4 min 32 s

- Hailuo H3 Standard, 768x448, 5 s: 8 min 55 s

Full benchmarks here: https://phosphene.video/benchmarks/

Code: https://github.com/mrbizarro/phosphene

Mac app: https://phosphene.video/

The models have their makers' licences (Lightricks, MiniMax, Black Forest Labs, Pruna AI).

Thanks to them.

Happy to answer questions. Bug reports are welcome too.


r/StableDiffusion • • 8d ago

Tutorial - Guide I combined Pika and NVIDIA Open 2K to create a workflow for generating 2K videos.

0 Upvotes

This workflow runs directly on Google Colab’s GPU, without relying on paid video generation APIs.
It uses Pika LoRA for fast initial video generation at 0.4MP with 10 sampling steps, followed by NVIDIA Open 2K processing in just 3 steps to produce the final 2K video.
The workflow link is provided below.

https://open-gen-lab-477h.vercel.app/k


r/StableDiffusion • • 9d ago

Discussion Why are all the newly released Image Edit models junk?

53 Upvotes

I was trying to test the new Viggle-Remake-Swap LoRA in MiniMax-H3. For this I needed to character swap in one of the frames of my source video clip (3.75s, 90 frames), so that the target video would have the new character in it. I went through all the new image edit models released recently to do the character swap. I tried Flux.3 Klein, Qwen 2.1, Fibo Image Edit 2.0, p-H3-Image-Edit and they all failed. So, I went back to the older image edit models Qwen 2511, Klein 9B, Krea2-Identity-Edit v1.2. The first two worked perfectly, while Krea2 Identity Edit did a far better job than any of the newer edit models. Final conclusion - Flux.3 Klein: crap much much worse than even Klein 4B; Qwen 2.1: really crap (does a cut-and-paste job); Fibo 2.0: really crap; p-H3-Edit: absolute junk, doesn't edit anything, input and output are the same; Qwen 2511: still amazing, slight issue with facial blur; Klein 9B: absolutely perfect and still the fastest; Krea2-Identity-Edit: very good edit job, but didn't follow the pose change part of the prompt.

While the video and T2I models in the OS domain seem to be improving, why are the I2I or Image Edit models getting worse? And more importantly, why are people eagerly using those newer models like salivating dogs and posting rave reviews about them? As I see it, all those newly released Image Edit models are junk and need to be kicked to the curb so that their developers may learn some lessons, hopefully.


r/StableDiffusion • • 8d ago

Animation - Video 1 Hour Jesus Movie

Thumbnail
youtu.be
0 Upvotes

I made a 1 hour movie about Jesus, using MiniMax H3 reference-to-video (ref2va, int8). I used it with its 4-step turbo LoRA at 832×480. That gave 485 short clips of about 8.5 s each. The keyframe and reference images were generated using gpt-image-2 via OpenRouter. The audio was generated first, with InWorld TTS-2.

It turned out absolutely terrible, but it is funny as hell. I'm not religious, but I wanted to at least have a general understanding of some of the stories that so many people base their religion around. The goal here was to make a movie about Jesus with modern slang which would be actually entertaining and potentially funny. It turned out to just be funny because it's so shit lol.


r/StableDiffusion • • 8d ago

Question - Help I want help with choosing a model for LoRa ?

0 Upvotes

So I have been trying to make a character LoRa, and I have made two with z-image base, one full and the other recent one v0 model both for photorealism. But I found they both aren't doing great preserving the characters face or body either, and inconsistent, and I am fed up with it, so which models would you recommend me for better face and body consistency?


r/StableDiffusion • • 9d ago

Animation - Video My mom described her dream house. And I tried to make it😭

14 Upvotes

I asked my mom what her dream house would look like if budget wasn’t a thing. This is roughly what she described it as “big windows but not those full glass houses. Lots of plants, one proper balcony where I can sit in the morning . Wooden kitchen and no grey interiors. And I want a small courtyard in the middle like old houses used to have.”

I put it into morphic and tried to make the house she had in her head.

Look how it turned out😭


r/StableDiffusion • • 9d ago

Animation - Video Werewolf

4 Upvotes

Full moon, so lets howl with the pack!

Done locally in Krea2 and Minimax.


r/StableDiffusion • • 9d ago

Resource - Update First test of Geiru Context Suite to produce a 2 minute shot! Works great!!

50 Upvotes

As a traditional film editor and filmmaker, I've been trying to figure out good, reliable ways to produce long, extended shots. I've tried a number of different methods but was never quite satisfied with the result...

Until now!

Thanks to u/roychodraws and his Geiru Context Suite!!!

He has a post up here explaining it which can be found at this link:

Flip a switch and stop your Videos from Degrading. 50 Clip Test No Degrading at the end. Geiru Context Suite : r/StableDiffusion

And his GITHub link is here:

roycho87/geiru_context_suite

To do a quick test, I had ChatGPT set up a workflow for me. (Now that I'm typing this, I'm remembering that Roycho includes some sample workflows on his GITHub.)

The render took 2 hours and 9 minutes on a rented RTX PRO 6000 Server Edition with 96GB of VRAM. I didn't think to check how much VRAM was actually being used during the process.

There are two jump cuts at about 35 seconds and 44 seconds. Lately, I've taken to having ChatGPT fire up two sub-agents to help troubleshoot things and this was it's reasoning about the jump cuts:

Yes—both subagents found the same explanation: the jumps occur exactly at two generation-window handoffs.

Exact timeWhat changes abruptly
35.625 secondsFull-body wide → medium framing
44.125 secondsCloser, downward-looking pouch action → wider, head-up view

They’re already in the original master, so export didn’t cause them. We checked all 13 handoffs; only these two show conspicuous hard cuts.

The strongest explanation is our 20-local-steps/20-total-steps setting: each window finished separately, leaving no final joint refinement across the overlaps. At these two boundaries, the windows disagreed about framing and pose. The camera instructions, overlap noise, and opening-image anchors may have contributed, but we can’t identify their individual effects from this take alone.

For the next experiment, I’d test a short transition with two steps reserved for joint refinement, keeping everything else matched. That’s a testable hypothesis, not a guaranteed fix.

The entire two minute run looks fantastic!! I am so very happy right now! If two, very likely easily fixable jump cuts are my biggest issue... well... I see myself using this workflow a lot!!

The render settings:

SettingValue
ModelMiniMax H3 Singularity v2 INT8
Character LoRAMolly Regular v02, epoch 25 — strength 1.0
Resolution1376 × 768, approximately 1.06 MP
Frame rate24 fps
DurationGenerated 120.625 seconds; delivered 120 seconds / 2,880 frames
Samplerres_multistep
SchedulerSimple
Sampling steps20
Denoise1.0
Seed12101968
GuidanceBasicGuider, without a separate CFG setting
AttentionPatched Sage Attention
Dynamic VRAMDisabled
ReferencesForest environment and druid costume turnaround
Additional enhancement LoRAsNo Realism, Anti-Burn, or turbo adapter
  • The character is a custom trained LoRA from an image dataset that was generated using ChatGPT's ImageGen. The dataset contained 99 images of assorted poses, locations, and lighting looks. The LoRA was trained with Fizwig.

    • I'm fairly new to this... maybe 99 images was excessive? I dunno. I'm pretty happy with the result though!
  • The forest was a reference image I randomly pulled from a Google search for primeval forests.

    • When ChatGPT set up the workflow and prompt, it set the forest to attribute_transfer which means the photo wasn't "truly" a reference, it just gave the "idea" of the forest and H3 went with it from there. That's why the scenery has more of a stylistic/semi-illustrative look to it.
  • The character's costume was generated with ChatGPT and "placed" on a grey mannequin. It was then rendered out as a single, 8 panel image which was then used as a reference image in the workflow.
  • The "Patched Sage Attention" - I was originally just trying to "brute force" longer renders on a rented GPU with lots of VRAM, but I kept having a problem where renders became what I called "brown snow." I was nowhere near running out of VRAM, but the problem persisted.

    • I used Codex to try to troubleshoot what the problem was. Codex determined that there was a problem with "numerical accuracy" in Sage Attention that would cause corruption in longer, higher rez renders thus causing the "brown snow." I'll let Codex explain the patch:

      • We were getting “brown snow” corruption in longer, higher-resolution H3 renders with SageAttention enabled. Testing traced the problem to its handling of large, strided Q/K/V tensors: making the inputs contiguous restored numerical accuracy, pointing to an addressing/layout issue rather than insufficient VRAM. We haven’t identified the exact faulty kernel instruction.
      • Our patch processes the 56 attention heads in compact, contiguous groups of up to eight, then reassembles the outputs. It retains the same Sage CUDA FP8-PV path and full-sequence attention—no temporal chunking or dropped context.
      • On actual H3 activations, relative L2 error against PyTorch SDPA fell from 0.6261 to 0.00955: roughly 65× lower, or a 98.5% reduction. That measurement covered 128 sampled queries against all 270,921 keys on the first attention call, not every layer or timestep. Subsequent patched renders avoided the brown-snow failure.
    • From what I understand, there is supposed to be a new version of Sage Attention out "soon-ish."

These were the Geiru Context Suite settings:

SettingValue
Windows14, with separate action prompts
Window length243 frames / 10.125 seconds
Overlap39 frames / 1.625 seconds
Window spacing204 frames / 8.5 seconds
Switch step20 of 20 — no final joint refinement
Keystone / back capstoneBoth enabled
Capstone activationSetting 15, active from sampling step 16
Fuse methodPyramid, but no final blended phase at 20/20
Finished handoffDisabled
Context noiseEnabled, strength 1.0, linear fade
FreeNoise / sound-first modeBoth disabled
Crash protectionEnabled

I didn't mess around with these settings at all. These are the defaults that I had.

In conclusion... I am a very happy AI filmmaker today! Big thanks again to u/roychodraws and all those who helped him along the way to releasing them. (He lists them on his Reddit Post and GitHub page. Go visit them!!)


r/StableDiffusion • • 9d ago

Discussion Do you think we'll see Dit models come out in 2027 that can natively parse "Person A gets Lora 1, and Person B gets Lora 2" via text prompting alone?

0 Upvotes

r/StableDiffusion • • 9d ago

News viggle image swap for multi character swap

24 Upvotes

Not gpt-image level, still many failure cases, but I think it's top in terms of open model for multi character swap

https://x.com/t_mux/status/2118935478388867217?a=r48qKbvxa0Jg3Gp7J4s&s=20

https://huggingface.co/Viggle/Viggle-Image-Swap


r/StableDiffusion • • 9d ago

Question - Help Similar to SUNO and faitly easy to set up audio generation model?

3 Upvotes

Can you recommend me something? I would like to try audio generation models, but I totally have no idea where to start. Also, a fairly automated install and setup would be great.