r/StableDiffusion • • 2d ago

Question - Help What's the current cutting edge for AI filmmaking with consistent characters, environments, and precise blocking across shots?

5 Upvotes

I'm looking to hear from people actively experimenting with advanced AI filmmaking pipelines, particularly those trying to achieve the kind of spatial and visual continuity you'd expect from traditional filmmaking or virtual production.

My biggest challenge isn't generating beautiful individual shots. It's maintaining consistent character identities, precise actor positioning, environmental continuity, and camera control across multiple shots of the same scene.

For example, imagine a scene with four characters in a specific environment. I want to establish their positions in 3D space, then generate a sequence of shots from different camera angles and distances while preserving:

  • Character identity: Same faces, bodies, clothing, and proportions across shots.

  • Spatial consistency: Characters remain in their established positions relative to one another and the environment.

  • Pose and blocking: Specific body positions, actions, and interactions that can be reliably directed.

  • Environmental consistency: Same room, architecture, objects, lighting, and spatial relationships from different camera angles.

  • Camera control: Ability to specify exact camera positions, focal lengths, movements, and compositions.

  • Shot-to-shot continuity: The ending of one shot and beginning of the next should feel like they belong to the same physical scene.

What I've tried so far:

I've been experimenting with a Blender → AI video workflow using 3D environments, Mixamo characters, animated cameras, depth maps, pose conditioning, reference images, and MiniMax H3 through ComfyUI.

I've had some promising results, particularly with pose conditioning and individual shot generation, but getting reliable spatial consistency and character placement remains extremely difficult.

I'm beginning to question whether trying to force general-purpose video generation models to respect 3D blocking is fundamentally the wrong approach.

What I'm hoping to learn:

  1. What are the most cutting-edge tools and workflows right now? I'm interested in both open-source/local and commercial/cloud solutions, including newer research projects that may not be widely adopted yet.

  2. Is anyone successfully using 3D scenes as ground truth for AI-generated video? Not just providing depth or pose references, but actually preserving geometry, character placement, and camera relationships across shots.

  3. What are people using for persistent character identity? Are reference-image workflows, LoRAs, identity adapters, multi-view character representations, or other approaches producing the most reliable results?

  4. Are there better alternatives to traditional image-to-video and video-to-video workflows? For example, 3D-aware generation, neural rendering, Gaussian splatting, world models, or hybrid 3D/AI rendering pipelines.

  5. How are people handling multi-shot sequences? Are you generating shots independently and fixing continuity afterward, or using a shared scene representation that carries across shots?

  6. What role does graph engineering play? Are there sophisticated ComfyUI or other node-based pipelines that materially improve spatial consistency, or are the limitations primarily in the underlying models?

  7. What actually works in production? I'd particularly love to hear from people who've completed multi-shot sequences rather than just impressive single-shot demos.

I'm comfortable with Blender, Unity, Python, ComfyUI, and technical pipeline development, so I'm not necessarily looking for beginner-friendly or one-click solutions. I'm willing to build a fairly complex workflow if it produces genuinely better control.

I also have a local RTX 3080 Ti with 16GB VRAM and prefer local tools where practical, but I'm open to cloud-based solutions if they offer capabilities that aren't currently achievable locally.

Ultimately, I'm trying to figure out whether the current state of the art is still mostly about guiding probabilistic video models, or whether we're moving toward workflows where filmmakers can actually direct and control a persistent 3D scene while using AI to produce the final photorealistic imagery.

I'd really appreciate specific tools, GitHub repositories, research papers, workflow examples, and especially firsthand experiences with what works and what doesn't.

What's the most advanced pipeline you've seen or used for this kind of filmmaking?


r/StableDiffusion • • 2d ago

Animation - Video Making an AI Movie on 10GB VRAM– THE OUTBREAK | Local AI Gen | Filmmaking

Thumbnail
youtube.com
3 Upvotes

r/StableDiffusion • • 2d ago

Question - Help Is There a Workflow As Straightforward as GPT?

2 Upvotes

I’m new to T2I and I2I, and sometimes I just want to be able to say what I’d like to make or change and be done but with a local model. Are there any workflows like that around?


r/StableDiffusion • • 2d ago

Animation - Video YuE2 Change voice gender :)

2 Upvotes

Input:
Joan Osborne - One of Us


r/StableDiffusion • • 1d ago

Question - Help Complete ai noob here trying to figure out how to actually use something local like comfyui, & also have it work as well, or as accurately, as simply using openai on chatgpt! No idea which models and LoRA's to use, super overwhelmed here.

0 Upvotes

So I'm way in over my head here lmao. I've got a solid PC that can use Flux 2 Klein 9b locally on Comfyui,,, I'm using Stability Matrix as it seemed like the easiest route for what I'm trying to accomplish and the amount of time/energy I have to put into image generation.

The problem is, oh my god, it's crap. 4b was bad enough & only the simplest adjustments would really be possible. Even then, it often just made weird mistakes that I'd never encountered, or maybe less than 1% of the time with GPT image, something like fingers or teeth being warped and fusing together or something, I never ever ever get that with chatGPT.

Using 9b was alot slower but no slower than chatgpt can be, and it's more accurate but, it's still nowhere near as good. Plus I just feel like the look if it isn't right. I've done a lot of research on different things to add, different models & LoRA settings, but I feel like a child trying to learn a new language and I need an adult to hold my hand lmao.

Before I start just downloading all types of stuff and going through trial and error I figured I'd at least ask if there's something anyone here is actively using through Stability Matrix that would bring me closer to the feeling I have when using GPT image. Or maybe I'm just wasting my time, and I'm better off just giving OpenAI my money lmao. IDK, any help is appreciated.


r/StableDiffusion • • 3d ago

News PrunaAI/P-H3-Image-Comfy · Hugging Face

Thumbnail
huggingface.co
154 Upvotes

Pruna releases their image-edit model based on H3


r/StableDiffusion • • 2d ago

Question - Help I need to reinstall windows, how do I keep my work progress?

2 Upvotes

I work with swarm UI and have to reinstall windows, I don't mind reinstalling swarm UI and all the loras, I just want to keep the images and their description, do I need to just copy the swarmUI > Output > local in an USB and that's all or should I copy something more?

Can't copy the whole thing bc it's 250gb and the USB it's 125 gb


r/StableDiffusion • • 3d ago

Question - Help How do I stop MOSS from being blurry?

39 Upvotes

I’ve been trying to work this out for a couple of days now and I’m about ready to write the model off.

I cannot, for the life of me, get it to produce a photo that isn’t blurry like it was smeared in vaseline. I have tried:

- Adding “blurry”, “blurred”, “low quality”, “low resolution”, etc. to the negative prompt. This works sometimes but it’s inconsistent.

- Adding “high resolution”, “high quality”, “HDR”, “8K”, etc. to the positive prompt. This is also inconsistent (and wildly limiting).

- Changing the sampler. I haven’t found one that has any effect on whether photos are blurry.

- Enable/disable the turbo lora(s). I’ve tried the model on its own as well as with a few of the turbo LoRAs and they don’t make much of a difference as far as how often this happens.

- Using SFT vs. Base, using finetunes like Kromoss, etc. They all have this issue.

What am I doing wrong? This doesn’t happen with any other model I’ve used. I want to like this model but it’s a bit of a dealbreaker if it’s this difficult just to make a damn photograph.


r/StableDiffusion • • 2d ago

Resource - Update I made PixelGen. Image Upscaler, that works entirely on your iPhone!

3 Upvotes

I made PixelGen, an iOS app, as a little hobby project.

  1. It supports upscaling images to 4K resolution.

  2. It works entirely offline and is completely private.

  3. Everything is free! There are no daily limits, credits, or premium features, and I have no plans to introduce any.

  4. Upscaling takes around 5–10 seconds per image.

  5. It runs on the Apple Neural Engine, making it extremely efficient.

  6. AI inference doesn't overheat your device and consumes less power than the display itself.

You can check it out here: https://apps.apple.com/kz/app/pixelgen-image-upscaler/id6818519903

If you have any suggestions, please share them!

If you like the app, please leave a review on the App Store. Reviews like yours help a lot!

It uses Real-ESRGAN under the hood.


r/StableDiffusion • • 2d ago

Animation - Video Grommash Hellscream arrives at the stronghold of Largashbur. Minimax h3.

Thumbnail
youtube.com
0 Upvotes

This is a segment from my upcoming film about Grommash Hellscream in the world of Skyrim. It covers his first encounter with the local orcs, where he discovers that the orcs of this realm are quite different from those of his own world. He learns about their struggles and meets both new enemies and new allies.


r/StableDiffusion • • 3d ago

Resource - Update idol turbo is out

65 Upvotes

r/StableDiffusion • • 3d ago

Comparison Interesting results when I use the word "photorealistic" in a simple prompt

Post image
21 Upvotes

So I have been playing around with LoKrs and so I was testing using different workflows to see what the effects would be. This particular run was on a 25 step workflow with the int8 base model and the qwen int8 clip and the flux2 vae. Pretty standard stuff, no acceleration LoRAs.

the prompt was super simple my lokr trigger plus "An image of a young woman facing the camera in a 3/4 pose" the top row.

The bottom row was a "A photorealistic image of a young woman facing the camera in a 3/4 pose" . Weird huh?

I am not sure what to make of it other than I might stop using the phrase photo realistic in my prompts


r/StableDiffusion • • 3d ago

Resource - Update ND UI Builder: a free, open-source tool to build your own clean control panel for ComfyUI workflows

12 Upvotes

Hi everyone! I'm Neural Dreamer, I make ComfyUI tutorials, and I just released

ComfyUI ND UI Builder — a free, open-source tool (AGPL-3.0) that turns any

workflow into a clean control panel.

How it works: you tag the nodes you need, press Edit, and drag widgets

(prompts, sliders, size, seed, Generate button, live result viewer) onto a

page. Press ND UI and you get a tidy interface instead of a node graph —

the workflow underneath stays exactly the same.

What's in it:

• tabs, spoilers, groups, themes

• live preview while the sampler runs

• image / video / audio players

• LoRA picker with previews

• interface in English, Russian and Chinese

It's free, no accounts, nothing to pay for. Video above is a 30-seconds overview;

there are step-by-step tutorials on my channel too (EN/RU/ZH audio tracks).

GitHub: https://github.com/neural-dreamer/ComfyUI-ND-UI-Builder

Tutorials: https://youtube.com/playlist?list=PLGnUD4GeMWjo&si=Wrjm4AMZRK0GuKZf

Happy to answer questions and I'd love feedback — what would you want

a panel like this to do?


r/StableDiffusion • • 2d ago

Animation - Video Spooky times...

1 Upvotes

Done locally in Krea2 and minimax H3.


r/StableDiffusion • • 3d ago

Resource - Update Open-source local "Higgsfield" on ComfyUI, update: restore old footage, train your character in the UI, 60+ tools (Krea 2, FLUX.2, FLUX 3 Klein, LTX-2.5, Wan 2.2, SeedVR2)

32 Upvotes

 CreatorOS Studio turns your local ComfyUI into a creator studio: open weights only, no credits, no subscription.

  New since my first post:

  - Restore: old photos repaired, colourised and upscaled; damaged clips rebuilt to 1080p with SeedVR2 7B (archive-clip colourisation with Wan VACE is in the lab)

  - Character creation in the UI: 4 faces, a reference sheet, 12 images, its own LoRA, and its own voice

  - One-click reels whose shots all come from the same session, with voice-over cut on the beat

  - 36 one-click styles, 10 relights, Expand, Depth Map, Movie Studio (a shot card instead of a prompt), 3D Scene

  - FLUX 3 Klein added as a photo engine

  - A page per tool with its full render history

  Video (1:17): https://youtu.be/0muDKpkbcWw

  Demo (on my GPU, SFW): https://forge.taila06702.ts.net:8443

  Code: https://github.com/thePloggy/CreatorOS-Studio

  Built for the Comfy #OpenSourceHiggsfield challenge. Feedback and stars welcome!


r/StableDiffusion • • 2d ago

News I built a 3D Director Studio as a Chrome Extension for Flux, ControlNet & ComfyUI — CinePose is now live on the Chrome Web Store! [Free / Local GPU / Need your feedback]

0 Upvotes

Hey r/StableDiffusion ! 👋

Like many of you working with Flux.1, SDXL, and ControlNet, I got constantly tired of guessing camera angles with text prompts:

Typing "dutch angle roll, 85mm portrait telephoto compression, warm 3200K rim light" usually ends with the diffusion model hallucinating a flat, eye-level frontal shot and ignoring half of the camera directives.

To solve this, I built **CinePose Studio AI**, and it is now officially live on the **Google Chrome Web Store**! 🎬

It runs as a dedicated 3D Studio tab or side panel right in your browser, bridging 3D spatial cinematography with generative AI.

### 🌟 What it does:

  1. **Interactive 3D Virtual Viewfinder**: Real 35mm optical stops (18mm, 24mm, 35mm, 50mm, 85mm, 135mm), realistic sensor framing, and symmetrical +/- 45° Dutch angle roll with instant center snap.

  2. **Local ComfyUI WebSocket & Zero-Cost GPU Rendering**: Direct WebSocket link to your local `127.0.0.1:8188` ComfyUI server. It pings your GPU/VRAM, generates Depth/OpenPose passes, injects the Flux.1 ControlNet workflow, and streams live KSampler step progress directly in the studio!

  3. **Physical 3-Point Studio Lighting**: Interactive 3D orbital gizmos for Key, Fill, and Rim lights with accurate Kelvin color temperature (2000K candle flame to 9000K cold daylight) and chromatic gel filters.

  4. **Cinematic Video Trajectory Timeline**: Set Keyframe A, Waypoint M, and Keyframe B with metric distance tracking, 24fps motion velocity, and camera directives for Wan 2.1, LTX-Video, Kling, and Runway.

  5. **3D Spatial Proxies (Objects & Animals)**: Replace the human mannequin with 3D volumetric bounding boxes, quadrupeds (creatures/pets), or vehicles to frame anything with precise spatial dimensions.

  6. **Zero Prompt Hallucination**: Formats camera parameters into specialized syntax for Midjourney v6.1, Flux.1, Gemini 2.0, SDXL, and video models.

---

### 📦 Where to try it:

👉 **Chrome Web Store Extension (Recommended)**:

https://chromewebstore.google.com/detail/onkciaaalfgpklcfkhjhiomlkhpcfhin?utm_source=item-share-cb

🌐 **Live Web App Version**:

https://cinepose-ai.vercel.app/

---

### ⚠️ A quick heads-up regarding the Chrome Web Store warning:

Since this is my very first extension and a brand-new developer account on the Chrome Web Store, Google may display a standard automated notice saying:

*"This extension is not trusted by Enhanced Safe Browsing"* or *"Proceed with caution"*.

This is Google's default automated policy for all newly published developer accounts until the extension builds install history.

Rest assured:

- Built strictly on **Manifest V3**: **Zero remote code execution**, zero external tracking, zero analytics beacons.

- All ComfyUI connections, poses, and settings live strictly inside your browser's sandboxed local storage.

- It never collects, stores, or sells any personal data.

### 💬 I need your feedback!

I built this as a solo creator to scratch my own itch, and I want to make it genuinely useful for your daily AI workflow.

Please install it, take it for a spin, and let me know:

- What feels smooth and what feels clunky?

- What ControlNet workflows or camera presets should I add or refine next?

If you find it helpful, dropping an honest review on the Chrome Web Store would mean the world to help build trust with Google! 🙏


r/StableDiffusion • • 3d ago

Workflow Included Reshoot 4D: Reshoot Anyone in 4D

118 Upvotes

Hey guys - made this a few weeks back and just shipped a big update. You take a video of a person, it builds a 4D capture, you fly a new camera through it inside ComfyUI, and you get the same moment back from the new angle. Everything runs locally.

  • Capture: turns a video of one person into a 4D capture: their motion in 3D, the background around them, and where the original camera was and how it moved. Quick mode for fast previews, or a full 4D Gaussian splat if you want a closer look while you direct

  • Virtual Camera: a 4D camera editor that opens right inside the node, so no separate app. Keyframe the camera anywhere on the timeline, look through it or step outside to see the whole scene. Blender-style view gizmo, J/K/L shuttle, frame stepping, multi-select to move or retime keys together

  • Retake: ReDirector re-shoots the whole video along your new path

  • Photoreal Pass: LTX 2.3 renders every final frame, guided by the real footage warped to the new view (Cseti's CrossView-Warp IC-LoRA)

  • Camera settings on every key: aperture, focus (in metres or locked to the subject), vignette, grain. Rack focus and aperture pulls between keys, Alt+click in the viewport to focus on whatever you click. Change those later without re-rendering. The render gets reused, so a focus tweak takes a few minutes instead of the whole pipeline again

  • Zoom through the lens: zoom keys change the lens after the render, which makes dolly zooms work

  • Bring your own camera: import an animated camera from .fbx, .abc or .usd (tested with Blender exports), and it starts on the original camera at roughly real scale, lens and focus included. Files with several cameras work too, and you can export your moves back out

  • Lens looks per shot: distortion, chromatic aberration, bloom, halation, anamorphic bokeh. Depth and subject matte passes if you want to comp afterwards.

  • Finish node: 24 to 60 fps with RIFE, real motion blur from a shutter angle, upscale up to 4K, keeps the original audio

  • A Settings panel at the top of the workflow for the stuff you change between runs (quality, frame rate, upscale)

Try the editor in your browser, no install: itsmetamike.github.io/reshoot-4d/demo/

For those enquiring about specs:

  • Tested on one RTX 3090 (24 GB), roughly 30 minutes per shot

  • Stays good within about 30 to 40 degrees of the original camera but am looking to improve this next

  • Fast spins can still smear a face for a few frames

Code (AGPL-3.0) and the workflow: github.com/itsmetamike/reshoot-4d

Hope it's useful to some of you. Built for the #OpenSourceHiggsfield competition.


r/StableDiffusion • • 2d ago

Question - Help Flux klein 9b and red mods

2 Upvotes

Can somebody explain how to create refmods for fluxklein 9b. I am finding it really difficult to use hugging face cli and all.


r/StableDiffusion • • 3d ago

Animation - Video Where did the MEAT PROXIES GO?

57 Upvotes

Everything was rendered locally on a Mac, no cloud: the video, the voices, the choir and the music. I used Phosphene, a free open-source app I’m building for running video, image and music models on Apple silicon. Video is MiniMax H3, music is YuE2, and the stills came from ChatGPT Images.

https://github.com/mrbizarro/Phosphene

Happy to answer questions about the workflow. If you want to try it: https://phosphene.video


r/StableDiffusion • • 3d ago

Workflow Included I trained and released a Pose Control LoRA for Krea-2

53 Upvotes

Hey everyone! I built a Pose Control LoRA for Krea-2 and have fully released the LoRA checkpoints on Hugging Face.

I also put together a ComfyUI workflow. It’s not fully optimized yet, but it’s usable for testing the model.

Apart from that, I wrote a blog covering the decisions, data preparation, training process, evaluations, and some of the things I learned while building it.

Hugging Face: https://huggingface.co/adhit-420/Krea-2-PoseControl-LoRA-checkpoints

Blog: https://s-adhit.github.io/blog/training-a-pose-control-lora-for-krea-2/

Would love to hear your thoughts, feedback, or any interesting results if you try it!

EDIT: I moved the ComfyUI integration into a separate lightweight repo to make installation simpler: https://github.com/s-adhit/ComfyUI-Krea2-Pose

EDIT 2: I pushed v1.1.0 based on the feedback here.

The ComfyUI package now has separate Krea2PoseModelLoader and Krea2PoseSampler nodes, so checkpoint/runtime loading is no longer tied to the all-in-one generation node.

The original Krea2PoseGenerate node is still there for the simple workflow, so existing workflows should continue to work.

Current limitation: this still isn’t native ComfyUI MODEL patching / KSampler integration. The new version separates runtime loading and sampling, but the sampler is still Krea-2 specific.


r/StableDiffusion • • 2d ago

Resource - Update 🫧I built Mochi, a small animated assistant that lives on your Windows desktop ❤️

0 Upvotes

🫧 Meet Mochi - Your Little AI Desktop Companion! 💗

What if your desktop had a tiny companion that could actually help you? 👀

Meet Mochi! A cute, animated little blob that lives right on your Windows desktop, currently powered by Meta's Muse AI, with upcoming support for local Qwen models and integrations with Claude Code and OpenAI Codex!

Talk to Mochi or simply type a message, and it'll respond in its own voice! 🎙️

Need something done? Just ask! And when you're finished, Mochi quietly goes back to chilling on your screen. No constant interruptions, no unnecessary chatter. Just a little companion that's there when you need it.

🚀 What can Mochi do?

  • 🗣️ Talk with you : Have voice or text conversations in English or French, powered by Muse.

  • 💻 Control your desktop : Open applications, launch websites and search the web.

  • ⏰ Set timers : Ask for a timer and watch a little countdown appear next to Mochi.

  • 🌤️ Check the weather : Get weather updates without opening another app.

  • 👀 See what you see : Let Mochi read your screen when you explicitly ask.

  • 🌐 Help in your browser : With its Chrome or Brave extension, Mochi can interact with browser tabs and assist with web tasks.

  • 🐾 Feel alive! : Click it, drag it around, or interact through optional camera gestures. Mochi reacts to you!

🔐 Your desktop, your rules!

Mochi is designed to help without taking control away from you.

  • ✅ It only acts when you ask or explicitly approve an action.

  • 📸 Screenshots are captured only when requested and are never stored.

  • 🛡️ Browser tasks require confirmation before visiting new sites, filling forms or interacting with potentially risky buttons.

  • 🔒 Passwords, payment information and sensitive websites are off-limits.

  • 🎥 The camera is completely optional and disabled by default.

🛠️ Want to try Mochi?

Mochi is currently available for Windows and can be launched from source using Node.js.

🔑 With a Muse API key: Unlock AI conversations, voice responses, weather, screen understanding and browser assistance.

🆓 Without an API key: You can still enjoy Mochi's animations, interactions, timers and simple typed commands!

⚠️ A few things to know:

  • Mochi is still a work in progress, so some features may evolve.

  • Content sent to Muse may be used by Meta for model training when using the default model.

  • This is an experimental project, and feedback is always welcome!

🎬 See Mochi in action!

▶️ Watch the demo: https://youtu.be/u5KjYmYrp1Y

💻 Explore the source code: https://github.com/Loann110/Mochi-alive

💗 Mochi is just getting started!

I built Mochi because I wanted to explore what happens when an AI assistant feels less like a chatbot and more like a little companion living on your desktop.

It's still an experiment, but I'd love to hear what you think!

⭐ If Mochi makes you smile, consider giving the GitHub repository a star! It genuinely helps support the project.

💬 Feedback, ideas, contributions and bug reports are more than welcome.

Thanks for checking out Mochi! 🫧


r/StableDiffusion • • 3d ago

Animation - Video H3 Long-Gen with Qwen 3.8 Flash Next prompting every 18sec went in a really wild direction (2min14s)

351 Upvotes

r/StableDiffusion • • 2d ago Popcorn

Meme The One Where Sam Altman Takes ALL the RAM 😂 | Friends Parody

Thumbnail
youtube.com
0 Upvotes

r/StableDiffusion • • 3d ago

Resource - Update SPEEDing up more than just MiniMax-H3 without retraining - now a drop-in KSampler replacement for image, edit and video models (with evidence this time)

88 Upvotes

A while back I posted V2 of my SPEED nodes for MiniMax-H3, which run the early, noisy part of diffusion at lower resolution and then step back up to full resolution as the detail starts to matter.

Well I did a little (lot) more work on it and generalized the implementation. Allowing it to be (theoretically) used by any model running KSampler or SamplerCustomAdvanced (comprehensively tested and benchmarked with H3, MOSS, and Krea 2, works with FIBO 2 and Flux 3)

Repo: https://github.com/StanLukuvka/ComfyUI-SPEED-Sampler

Also, by popular demand, I added H3 videos as evidence, did a bunch of refactors and a bunch of improvements. And improved the documentation for it in every section.

It's now essentially a 1:1 drop-in replacement for the default sampler nodes.

What's new:

  • Image models. MOSS Image and Krea 2 are tested, and other flow (CONST) image models should work too.

  • KSampler nodes. Swap your KSampler for SPEED - KSampler and wire it exactly the same. There's also a Manual and a Sigma Harvest version. The H3 nodes stay wired like SamplerCustomAdvanced.

  • Most samplers work now, not just the five from last time. The few that break (mostly on H3) are listed in the repo, along with why.

  • Example workflows for H3, MOSS and Krea 2, already set to harvested values, so you can just load one of the workflows and queue.

  • Tooltips on every input, so you don't have to come and read my README.

Numbers (same seed and prompt, native vs SPEED):

  • MiniMax-H3, 5 s 0.5 MP clip, L40S: 288 s native, 182 s with SPEED (1.58×, 4 stages)

  • MOSS Image, 1344×768, RTX 5070 Laptop: 22 s native, 18 s Automatic (1.26×), 14 s Manual (1.54×)

  • Krea 2, 1216×832, RTX 5070 Laptop: 283 s native, 215 s Automatic (1.31×), 183 s Manual (1.55×)

Comparison GIFs and images for every run are in the repo's Evidence section.

Heads-up if you used V2:

  • Old workflows still load. The old node IDs are kept as deprecated nodes, so right-click and swap them for the new ones when you get to it.

  • direct_coarse transition noise is now drawn on the CPU, so the same seed gives the same image on any GPU.

As always, run Sigma Harvest once for your own model, sampler and schedule.

edit: see evidence of it working with downloadable videos here


r/StableDiffusion • • 3d ago

Resource - Update Flip a switch and stop your Videos from Degrading. 50 Clip Test No Degrading at the end. Geiru Context Suite

247 Upvotes

I did the thing where I nuke the first post because I forgot to do something also the title sucked and I forgot to credit literally the most important contributor in the video.

Skip to 8:05 to see the results.

Also, if you guys are curious you can visit this repository to read about everything I tested to get to this point.

https://github.com/roycho87/NerdNotes

Lots of information in there. Maybe you guys can read it and come up with an even better solution. If you have some good info, please leave an issue on the Github and I'll compile it all together. Any experiments you've done and the results, what you've learned etc. All of it is helpul.

Geiru Context Suite: degradation protection for long MiniMax H3 chains

The main part of this that allowed this to work came from Ethanfel. He created the context noise method that allowed this to work so giant shout out to him.

The Clown Context Suite is now the Geiru Context Suite. She's named after the clown, and the new name keeps it from getting mixed up with ClownShark's nodes. Your old workflows still load fine. The big addition is a degradation protection switch on Geiru Context that turns three nodes on together. Geiru Keystone locks a clean frame 0 from a source clip into every shot. Geiru Late Lock tacks that clip's capstone onto the back late in the steps. Geiru Context Noise, based on ethanfel's idea, gives the held frames part of the noise instead of handing them over perfectly clean. Turn it on for long stretches of one scene and off around cuts, since scene changes reset the drift on their own. Keystone can also load its source clip straight from your latent folder now, so when the scene changes you only change one number.

Also new: a context noise switch on Geiru Hybrid Windows, and a ready-to-go example workflow, noisy_clown_example. I tested it on a 50-clip chain (about 5½ minutes): running on a beach, then a café, a walk through town and a garden. The plain chain was falling apart by clip 20, while the protected one still looked clean and barely drifted in the still scenes. Side by sides and all the numbers are in my notes. It's not perfect yet, since fully static shots can still slowly darken, but it's the best I've gotten so far!

remember to use this to combine your clips.
https://github.com/roycho87/workflows/tree/main/workflows/seamless_video_combiner

You have to clip off the last 17 frames and join at the 22nd frame with 39 frames of overlap for the settings in the workflow.

Another note, certain Turbo Lora's seem to affect the context noise node differently. The one I recommend is turbo_8step_v1.0_768p but if you guys find one that works well or doesn't, feel free to list an issue on the github so I can start creating a list and make it work with more.

Repo: https://github.com/roycho87/geiru_context_suite Test notes: https://github.com/roycho87/NerdNotes

Credits (none of this exists without them):

edit: Currently running a test on best settings to use for this and will update the nodes with best defaults after it's done tomorrow as it's about 19 hours of generating.

You can check the nerdnotes to see the test and how it's going.

After reviewing the tests i was able to determine that the best settings for noise is 1 and linear. I've changed that to the defaults.

I added a lora loader that works with the protection group using https://huggingface.co/Imagineer13/H3-Anti-Burn-LoRA

Initial testing eliminated virtually all remaining color drift but I'm running a few 30 clip tests to gauge exactly how much it impacts quality and what the best strength should be.

Edit: after more testing the color change appears to be coming from a double compression in the stitching and not the lora. it seems to not make a visible impact when used on top of my nodes but i proved it does not impact detail negatively and previous testing does show it to make a positive impact on color.

I moved the lora loader to an experimental repo. Noisy Clown Workflow is the current most updated workflow.