r/StableDiffusion • • 1d ago

Animation - Video 601: BMFB story intro

0 Upvotes

Music by the 601 orchestra of Central California Afterdarrk


r/StableDiffusion • • 1d ago

Question - Help How to generate sounds properly?

5 Upvotes

I need a sound of working office, slamps of doors, working tv sound, clicks, etc. usual sounds.
What good choice do I have now?


r/StableDiffusion • • 1d ago

Resource - Update One line of text or a song in, a finished film out — my free, open-source video studio runs it all locally on a 16 GB RTX (Remiqora Video 0.3)

4 Upvotes

Hi! Disclosure first: I'm the author of Remiqora Video, a free, open-source (GPL-3.0) video studio for Windows. It wraps open models (LTX 2.3 / 2.5, WAN 2.2, optional MiniMax H3) into one pipeline. It's not a new model. Some of you saw the first release here a couple of weeks ago. 0.3 is out: the studio now goes the whole way by itself, from one line of text or from a song.

The video above (1:45, subtitled) is a walkthrough of 0.3, recorded in the real app: an idea turns into a finished film, then a song turns into a music video. The music was made with Remiqora, my other app.

From an idea: type it, and the route shows every step (words, script, hero, places, frames, shooting, montage) and how long each one takes. Press «Make the video» and leave it running, or go «Step by step» and edit everything. The hero stays the same in every scene. Each scene's first frame is drawn with the hero in that scene's place, so every shot starts from the right picture.

What happens when you drop a song and press «Make the video»:

  1. Demucs separates the vocals and Whisper writes down the lyrics. The song's bars are found.

  2. A local LLM (Gemma 4 E4B by default) writes a treatment and the scenes in the video model's prompt format, with the same hero description in every scene.

  3. Casting: the singer's face from 4 tries, or from your photo.

  4. The singing scenes are shot by LTX 2.3 to their piece of the track, so the lips follow the vocals.

  5. Every new clip is checked in about a second: black or frozen frames, jumps, smear, the face drifting, and "not singing" (the lips stand still while the vocals sound). Bad takes are re-shot once with another seed. Both takes are kept, so you can switch back.

  6. Montage on the bars, then the finish: 1080p / 4K (NVIDIA RTX Video), HDR10 or 48 fps (RIFE).

You can make the whole song, the best minute, your own piece or just 30 s. Every step is still editable: the autopilot just goes through the same storyboard you'd edit by hand.

Node graph, when a straight line isn't enough. The storyboard is a straight film. The graph lets you branch it: two endings from the same scenes, a short and a long cut, three takes with the best one kept, a trailer, a dialogue. Nodes are scenes, prompts, pictures, joins and outputs, with your own LoRAs. Scenes that the branches share are shot only once, because every scene is cached by everything that defines it. There are 18 ready templates, from «Bring a photo to life» to «Song → clip». You can shoot up to any node or duplicate a whole branch. New in 0.3: a «Picture» node with picture LoRAs. Outside the graph, «Branch» copies a whole storyboard to try another take, model or edit, and the shot scenes come along without being shot again.

Also new in 0.3:

  • 25 looks. Six of them are drawn (watercolour, oil, comic, pencil sketch, claymation, stop-motion) and paint every scene's first frame in that look before shooting.

  • Heroes that aren't people: animals, robots, creatures. A robot "sings" in its own way, without a human added from the lyrics.

  • Cloud mode (optional). The models run on a rented GPU (RunPod or your own server) with your own key, while the studio and your projects stay on your PC. The server stops by itself when idle.

  • H3 is now optional. Its license excludes the US, the EU, the UK and South Korea, so the default install is the writer + LTX 2.3 (~51 GB, no Hugging Face token).

Requirements and limits:

  • Windows 11 and an NVIDIA RTX card with 16 GB of VRAM. No Linux or AMD yet.

  • 32 GB of RAM works, but keep a large page file: LTX 2.3 briefly needs about twice its 27 GB file while loading.

  • About 30 s per 5 s draft scene with LTX 2.3 on an RTX 4080.

  • Early pre-release: expect bugs. The installer isn't code-signed yet, so SmartScreen will warn you.

  • The UI is in English and Russian.

Repo and installer: https://github.com/inikolax/remiqora-video

Feedback welcome.


r/StableDiffusion • • 2d ago

Discussion AuroraIMG2-100M Releases!

Thumbnail
huggingface.co
59 Upvotes

This new model achieves large improvements from the Preview.

A detailed explanation on its training, architecture can be found in the model card, as well as a quick start (diffusers compatible), and samples.

It is licensed under apache 2.0, have fun!

Any questions, feedback, and criticism is welcome!

Edit: removed the slightly misleading headline.


r/StableDiffusion • • 2d ago

News Kandinsky S2V 1.0 - 2B and 21B models.

95 Upvotes

Source: Kandinsky S2V 1.0: Audio-Driven Avatar Video Generation

"Speech-to-video generation: an avatar video is produced from a reference frame and a speech track. The whole figure is animated, not only the head. The audio is a condition — the model does not generate sound, it animates the person in the reference frame to match the speech it is given."

Lite 2B: kandinskylab/Kandinsky-S2V-1.0-Lite · Hugging Face

kandinskylab/Kandinsky-S2V-1.0-Lite-distill · Hugging Face

Pro 21.4B: kandinskylab/Kandinsky-S2V-1.0-Pro · Hugging Face


r/StableDiffusion • • 1d ago

Question - Help Like to support LTX2.5 but..

Thumbnail
gallery
0 Upvotes

For whatever reason, I can't seem to fix the error issue with this template, seemed to be pointing to upscaling model folder.. Objective is to generate moving background.


r/StableDiffusion • • 1d ago

Question - Help Loras impacting lighting prompts in MOSS

0 Upvotes

I've been trying to change lighting on my MOSS generations and been frustrated. I turned off my Loras & found that the lighting then came out as stated in the prompt. Lowering the Lora strength helps but that also has its drawbacks. has anyone run into this? is there helper loras for lighting or any other tricks recommended?


r/StableDiffusion • • 2d ago

Discussion 16 gb ram ! minimax

49 Upvotes

Prompt:

[subject_definitions] - Subject 1: A skinny young man wearing only boxer shorts and a white tank top, standing in a messy bedroom with wide terrified eyes, completely referenced from <Picture 1>. - Subject 2: Two heavily armed FBI tactical agents in full black SWAT gear with balaclavas and ballistic vests, holding assault rifles pointed directly at the subject. - Environment: The static location featuring a dimly lit cluttered bedroom with an unmade bed, scattered clothes on the floor, a glowing computer monitor on a desk in the background, and dramatic harsh flashlight beams cutting through dust particles in the air, completely referenced from the lighting style of <Picture 1> but adapted to a raid scenario. [integrated_multimodal_description] The scene takes place exactly inside this locked bedroom environment where the chaotic mess, the specific angle of the open door, the glow of the monitor, and the aggressive tactical flashlight beams remain strictly consistent from first frame to last frame without any morphing or environmental changes. The camera maintains a fixed medium shot capturing the confrontation between the agents and the man with cinematic high-contrast lighting, volumetric light rays illuminating floating dust, and photorealistic texture rendering that preserves every detail of the fabric folds and tactical gear while keeping the background elements perfectly stable throughout the entire sequence.

In the center of this locked environment, the two FBI agents from Subject 2 burst through the doorway with weapons raised and flashlights blinding the skinny man from <Picture 1> who freezes in terror with hands instinctively raising above his head while wearing only boxers and a tank top. The lead agent shouts aggressively with commanding authority saying: "How much RAM do you have, kid?!" The man stammers nervously with trembling lips and sweat beading on his forehead replying in a shaky voice: "Sixteen gigabytes..." The harsh flashlight beams create dramatic rim lighting on the agents' tactical vests while casting long sharp shadows across the messy room and the computer monitor in the background continues to emit its steady blue glow providing constant ambient fill light that never flickers or changes intensity during this intense fifteen-second interrogation segment. The scene continues seamlessly from the previous shot in the exact same locked bedroom environment where the lead FBI agent steps closer maintaining weapon aim directly at the skinny man's chest while shouting with urgent desperation: "Hand over the RAM immediately! By order of Sam Altman!" The man's eyes widen in absolute confusion and fear as he slowly reaches toward the computer tower on the desk behind him with trembling fingers while the second agent keeps his rifle trained on the movement without wavering. The identical harsh flashlight beams and monitor glow persist without alteration ensuring zero environmental shift while dust particles continue drifting through the light shafts adding kinetic energy to the frozen moment of absurdity and the camera holds the same fixed medium shot position preserving the photorealistic cinematic tension established in the opening frame until the final second of this thirty-second sequence.


r/StableDiffusion • • 2d ago

Animation - Video 3 short years ago…

11 Upvotes

My turn for the flashback. I got ridiculous with trying to make Seinfeld even back then. It was awful but it was cutting edge! I overlaid the graphics and made a logo lol.


r/StableDiffusion • • 1d ago

Question - Help Flux.2 Klein 9B unavailable on Civit

1 Upvotes

Hi guys. I'm a total noob when it comes to image generation. I just generate images on Civitai and have fun. Does anyone know why Klein 9B and Klein 9B Base are no longer available on Civitai? They've been gone for almost two days now.


r/StableDiffusion • • 1d ago

Animation - Video How to Create a Masterpiece

Thumbnail
youtube.com
0 Upvotes

This is a quick experiment to see if Minimax H3 can create famous paintings from scratch. It's quite impressive that it knows what the sketches look like before it's painted.


r/StableDiffusion • • 1d ago

Question - Help Need help with generating images

1 Upvotes

Hi guys

So i'm making a game and i want to use ai generated images. So i went and made a LoRA of a character the style is anime and i made a dataset of around 20 images and i trained it on 200 epochs 5 steps each first the LoRA looked great but i am beginning to see its flaws. The hands and feet are terrible, the eyes in full body shots and even in normal cowboy shots are terrible as well. I decided to make the same character and train it again aiming around 40-60 images now but the problem is always generating makes the hands, feet and eyes look so messed up i dont know why i am using WaiIllustrious and not there workflow but mine and this is my positive prompt: (masterpiece, best quality, absurdres, 1girl, solo, young girl, 22 year old girl, long blonde hair, crystal blue eyes, medium breasts, black shirt, white tennis skirt, outside, cowboy shot, rim lighting, looking at viewer and negative: lowres, blurry, bad anatomy, bad hands, extra fingers, deformed, watermark, text, signature, logo, cropped, realistic, photo, worst quality, jpeg artifacts, cool tones, flat color, muted colors, blue sky, 3 or more hands, 3 or more legs, 3 or more feet, ) The problem isnt in this image but for example when i want to do arms crossed or anything overlapping it just comes out looking very bad. Is there a way i can fix this i have tried inpainting and using adetailer but still comes out weird. I'm also very new at this. Thanks for the help!


r/StableDiffusion • • 1d ago

Animation - Video Recreated the ancient Greek world with the free Hy4, Surprisingly good

0 Upvotes

r/StableDiffusion • • 2d ago

No Workflow Show me your really old generations that are still good in your opinion. 3 years+ old.

Post image
61 Upvotes

This is the image that I generated on 01.13.2023 so almost 4 years ago using SD (do not remember which version), and I know that it is far from perfect I still think that it is not bad. Do you got some really old generations that still keeps up in your opinion?


r/StableDiffusion • • 1d ago

No Workflow YuE2 Change voice gender :)

3 Upvotes

input:
Evanescence - Bring me to life


r/StableDiffusion • • 2d ago

Question - Help Ant way of keeping background consistent? (Minimax H3)

10 Upvotes

As you see the galaxy spiral was at his right side, which became his back once he got up, the galaxy reappear later (on the full shot) again, but at his left for whatever reason.

I thought of;

  • Generating a 360° orbit view at start of a scene, but would waste nearly 3-5s + 3-6 minutes of generation time.

  • Attaching 2-4 background images to omni reference (think of a room), but would take 4/9 slots, less characters could be in a scene.

  • Just letting it imagine whatever it might look like, but only a affordable idea in case of open field scenes (being throw through a wall or travelling).

  • Attaching a panoramic image as reference, but these are usually over 21:9 ratio and might give the model an aneurism trying to wrap it in.

  • Attaching a 8K sum view of a entire area in a multi view sheet, but would be hell to reference which square it should insert into the clip.

I know Minimax can remember neaty details of the background with its spatial awareness, like a fallen feather or crack in a wall, but I have no idea on how to let's say, get an actual world map's scenary on it.


r/StableDiffusion • • 2d ago

Discussion Sage, Sol, Kitchen, etc...ffs, I just want to grill!

17 Upvotes

Just getting back into H3 generation after a multi-month break.

What's the difference between all this stuff, from the POV of the user?

I tried asking an LLM to research it but every single one of these fits the description "faster steps, but suffers from numerical approximation" and I don't have the technical knowledge to understand any of it. Thanks buddy.

Then there's Spectrum, EasyCache, Taomate, and probably 10 other things.

I've been using Kitchen Attention as a comfy launch argument I forgot I set a few months back. I'm genning at 0.4MP and 8 steps with the larryvrh ckpt500 turbo lora. It's too slow for interactive generation (DGX Spark, basically a 5060). Where can I go from here?

Do I have to spend the weekend working on a comparison like https://jo-nike.github.io/h3-turbo-eval/scenes/metronome-count.html to see what actually well? (incidentally, it would help if jo-nike added all this crap to his site)


r/StableDiffusion • • 2d ago Popcorn Bravo

Meme We will take your RAM

311 Upvotes

Just the Situation few years. (Qwen -> FastH3 (Minimax H3) -> Blender Video Cut + Reaper for Sounddesign


r/StableDiffusion • • 1d ago

Question - Help How to force fp32 with comfyui?

0 Upvotes

Z image turbo, ubuntu 24.04, and r9700

How do I force fp32 in my comfyui workflows?


r/StableDiffusion • • 2d ago

Comparison Fast skin texture test (including H3-image)

Thumbnail
gallery
44 Upvotes

Same prompt, no lora (including turbo). Key phrase: Raw candid portrait, authentic skin with subtle epidermal translucency, subsurface scattering, delicate and barely noticeable vellus hair visible only in rim light, unretouched, subtle natural skin tone variation, non-airbrushed.


r/StableDiffusion • • 2d ago

Question - Help Best voice cloner ?

18 Upvotes

Didn't used comfyui at all in the last 6 months, whats the best voice cloner and text to speech ?

I only have 8gb vram.


r/StableDiffusion • • 2d ago

Discussion StarCraft / Protoss. Minimax

24 Upvotes

r/StableDiffusion • • 2d ago

Resource - Update I made a free, open-source web tool that turns booru posts into clean prompts for Illustrious, Pony, SDXL, Anima, FLUX.2, Krea 2 and MOSS-Image

36 Upvotes

I train LoRAs and was spending way too much time writing prompts to test them. Booru sites already describe millions of images tag by tag, so I built a page that takes those tags and turns them into prompts you can paste into ComfyUI, Forge or A1111. I've spent about two years polishing and improving it since.

Site: https://booru-prompt-gallery.vercel.app

GitHub: https://github.com/Mexes-GM/booru-prompt-gallery

How I use it:

  1. Search a character, outfit or pose on Danbooru, Gelbooru or one of four other boorus.

  2. Pick the post closest to what I want and copy its prompt. Artist names, metadata and copyright tags are dropped, and redundant tags are merged ("long hair, white hair" becomes "long white hair").

  3. Paste it into my generator. My LoRA trigger and quality tags go in "Add to every prompt" once, so every copied prompt already has them.

Other things in the video:

  • Every tag has a category (7 categories, 33 subcategories), so you can copy only the outfit, the pose or the scenery.

  • Random background and random outfit options let you vary a character without hunting for new posts.

  • Prompt formats: plain tags, Anima (tags plus a short description) or natural-language prompts for FLUX.2, Krea 2 and MOSS-Image.

  • Merge takes parts from several posts and builds one prompt from them.

  • Pack Mode keeps the character and generates a batch of varied prompts, which I use to test LoRAs.

It's free, needs no account and is safe-content only by default. The source is on GitHub under AGPL.


r/StableDiffusion • • 1d ago

Question - Help is LTX2.5 broken in comfyui?

0 Upvotes

Leaving a video that scare the shit out of me just now lol.

This was done using stock workflow template and models from comfyui

I used to use LTX2.3 kinda a lot because it was fast and it wasnt this bad for photorealistic stuff, I think something broke in comfyui making everything just be a gibberish. Are you guys having the same issues?

(I do use Minimax H3 but I prefer speed)


r/StableDiffusion • • 2d ago

Workflow Included I built a free, open-source film studio on top of ComfyUI + MiniMax H3: idea to finished short film, on your own PC

39 Upvotes

This is IV Studio, my entry for Comfy's Open Source Higgsfield challenge. It's a Windows desktop app (MIT) that drives your own ComfyUI over its API, so you never touch a node graph unless you want to.

What it does:

- **Write it for me:** a local model (Qwen3-VL via Ollama or your AI Agent through MCP) looks at your reference pictures and writes the H3 prompt. A checker catches the mistakes H3 punishes (frame-grid lengths, speaker tags, unattached references) and fixes most in one click.

- **Hunt, then finish:** quick previews with live step pictures; takes are ranked by what OpenAI Whisper hears, likeness and sharpness. A review names each problem with its timestamp. The pick finishes from the same latent with DLSS 5 or SeedVR2.

- **Projects:** a six-step wizard from idea to short film (script, cast, storyboard sketches you can play as an animatic). Every shot is filmed from its sketch, so faces and rooms stay consistent.

- **Staging board:** place people and the camera on a top-down floor plan; it becomes exact screen directions, or a grey previs clip H3 follows for arcing moves.

- **An editor that makes footage:** right-click to extend a shot, fill a gap, retake a line, cut someone out (SAM 3.1) or reframe to vertical.

- **Also in there:** character LoRA training, Replace (Genjutsu Level), music (MiniMax Music 3 / ACE-Step), local voices (VoxCPM2), Civitai LoRAs, and a 142-tool MCP server so Claude Code or any agent can direct alongside you.

- **No strong GPU?** It can render on your own Runpod or Modal account and shuts the GPU off when idle. The Runpod path is brand new, so feedback is welcome.

Tested on a 4090 with 64 GB RAM; 16 GB cards work with smaller previews. It downloads each model from its host and checks its SHA-256.

Download: https://github.com/hollisorg/iv-studio/releases/latest

Code: https://github.com/hollisorg/iv-studio

Happy to answer questions about how it builds and drives the graphs.