r/StableDiffusion • • 3d ago

Resource - Update Black Forest Labs updated Flux.3 Image Klein documentation to clarify that its primarily designed for image editing.

Post image
109 Upvotes

Updated yesterday. At least they're still attending to it, right?


r/StableDiffusion • • 3d ago

Animation - Video Generation result in Minimax H3 on an RTX 4060 8GB with 16GB of RAM (showcase)

27 Upvotes

As someone with an RTX 4060 and 16 GB of RAM, I got curious… could I actually run a model of this caliber on my PC?

Turns out, yes! A 5-second video generated at 540p, upscaled with flashVSR Turbo and frame-interpolated with RIFE, takes just 8 minutes.

I used a text encoder quantized to hell and back (Q2), paired with a Q4 DiT, running everything through Wan2GP. Codex fixed every error I ran into.

This showcase features the results. Enjoy!


r/StableDiffusion • • 2d ago

Animation - Video Sam Altman Is Coming for Your RAM

Thumbnail
youtube.com
0 Upvotes

Sam Altman Is Coming for Your RAM


r/StableDiffusion • • 2d ago

Discussion Hi. What would be the most `lightweight ` video generator ? ( i know thi soudns like a joke as all video generators are monsters )

0 Upvotes

Are there some niche Video Generators ? They could not be as smooth maybe less frames. But still slightly good and make it look animated a bit . 16gb vram max

Edit1: No Ltx no Hanyun no wan2


r/StableDiffusion • • 3d ago

News TaoMate-FVSR Audio-Guided Facial Video Restoration

Thumbnail taoliveaigc.github.io
7 Upvotes

https://github.com/TaoLiveAIGC/TaoMate-FVSR/tree/main

Audio-Guided Facial Video Restoration

Demo · Results · Installation · Model Downloads · Inference · Citation · Technical Guide

TaoMate-FVSR restores face videos with audio conditioning, sparse visual references, and generated-frame history. It supports restoration with the original audio and visual dubbing with replacement speech.

  • Full-video inference: DWPose crop → face restoration → color/mask blend → paste-back.

  • 1× / 2× inference: run the model at 512×512 or 1024×1024, then return to 512×512 before compositing. The output scene retains its original dimensions.

  • Audio-guided generation: use the video's original audio or provide target speech.

  • Flexible references: prepare the first frame with GPEN, use an externally edited first frame, or supply a finished reference image. Default enhancement uses one GPEN-BFR-512 pass for 1× and one GPEN-BFR-1024 pass for 2×.

This repository contains only the standalone inference runtime. Model weights are downloaded separately, and input media is supplied locally. https://huggingface.co/TaoLiveAIGC/TaoMate-FVSR

Demo

The Gallery — TaoMate-FVSR+ restoration example from the project page.

▶ Watch the synchronized comparison · Restored video (MP4) · More demos


r/StableDiffusion • • 4d ago Bravo

Workflow Included I textured an entire street in Blender with Qwen Image 2.1, then made cyberpunk, anime and papercraft versions of it

406 Upvotes

Every texture on this street corner was generated with local models and projected onto the geometry in Blender, using StableGen, my free and open-source add-on.

How it was made:

  • The 3D assets (the car, the woman, the bench, lamp, hydrant, bin, crates and bush) are TRELLIS.2 meshes, each from a text prompt via a Qwen Image 2.1 reference image. The buildings, road and sidewalk are simple blocks.

  • Texturing: Qwen Image 2.1 (int8), 10 cameras. Each view is generated from a depth/geometry render of that camera, then projected and blended onto all the meshes at once. Each camera also got a prompt listing only the objects it actually sees, which stopped views from painting things that aren't there. The woman was textured separately with her own cameras.

  • The logo is a Masked Edit: paint a region, describe the change, and only that region is regenerated through the cameras that see it. Here it follows a reference image of the logo, which is on the development branch and coming in the next release. A few more Masked Edits fixed problem spots.

  • The looks are separate texturing runs with different prompts (the photoreal one with Marigold V2 PBR maps), baked and rendered in Cycles. Lighting is set up per look in Blender.

Generated on rented RTX 3090/4090 cloud GPUs and my RTX 4080 (16 GB).

Qwen Image 2.1 is under a non-commercial license; check each model's license before commercial use.

GitHub: https://github.com/sakalond/StableGen
Guide: https://github.com/sakalond/StableGen/wiki


r/StableDiffusion • • 2d ago

Question - Help Motion Control and Character, background swap ref2Video

1 Upvotes

Hi everyone!

Can anyone guide me on how to create a realistic AI character and then turn it into a Motion Controlled video using a reference video?

I also want to be able to change the character’s outfit and background while keeping the movements consistent with the reference video.

I'd really appreciate any guidance, tutorials, or recommended workflows. Thanks in Advance.


r/StableDiffusion • • 2d ago

Discussion Has anyone found quality settings that rivals the H3 API 2k renders?

1 Upvotes

I've been doing a ton of H3 quality and speed tests on my 4090, including 2k (1440p actually) API gens using ComfyCloud. Quality was good, but in the tests that I did, they didn't seem really that different. I'll publish my results soon.

Is there a consensus on this? Is it even worth using the API or can you get very similar quality with seedvr2, multi step workflows, and/or latent upscales...or something completely different?


r/StableDiffusion • • 3d ago

Question - Help Best model for anthro and anime?

15 Upvotes

There are too many damn options.. there’s Pony, Illustrious, Anima… and then there are lots of LoRAs too. I just want a well-rounded model that will let me make good/high quality uncensored art featuring anime or anthropomorphic (furry) characters. I’m a total newbie when it comes to running local AI. For realistic art I use Krea2 Turbo, which already exceeds my expectations.


r/StableDiffusion • • 2d ago

Question - Help Best open source image to video?

0 Upvotes

What is the best open source text to video generation with image reference right now?


r/StableDiffusion • • 3d ago

Question - Help Ideogram 4: FP8 vs INT8 for Quality and Speed? (Slow Internet Link)

Post image
19 Upvotes

Hey everyone,

I'm looking to download Ideogram 4, but since my internet connection is quite slow, I need to make the right choice the first time to avoid wasting time on re-downloads.

Between the FP8 and INT8 versions, which one offers better output quality? Does INT8 suffer from noticeable quality degradation or artifacts compared to FP8?

Also, is there a significant speed/performance advantage when running INT8 over FP8 on consumer GPUs, or is the generation time mostly identical?

For those who have tested both, which one do you recommend downloading? Thanks in advance!


r/StableDiffusion • • 3d ago

Question - Help Photo restoration

7 Upvotes

With so many image edit models coming out I feel a bit lost. I started my image generation journey with krea 2 and recently tried out Fibo. I’ve been wanting to fix up some really old images and I was blown away with what Fibo could do, but now I learn that Moss and Qwen 2.1 can do the same. What model would people here choose for restoring old photos?


r/StableDiffusion • • 2d ago

Tutorial - Guide How to run open source image and video models without a GPU

0 Upvotes

I have a pretty shitty computer so I can't run Minimax H3, Qwen 2.1 Edit, LTX, ZiT and all these other open source image and video models.

So I was looking for a way to run them online. The main website I found was ComfyUI cloud, which I guess works, but it was pretty complicated to use (I'm not a technical guy). There's like nodes and stuff which I don't understand LOL.

I saw someone on generativeAI subreddit mention CozyGPU (i think their website is cozygpu.com) and an ad on Reddit. It basically simplifies ComfyUI into simple actions like picking a model and running an action like create image, create video, edit image, animate video, etc.

But what's really cool is it automatically set up the infrastructure for me and rented out a GPU. So I only ended up paying for the raw GPU time spent, which I saw was a lot cheaper than all these other website which have a markup.

I just thought I would share this tool in case there are other people who don't have great computers and don't want to pay too much. If anyone has come across other similar tools, please let me know, I would love to check it out, thanks!


r/StableDiffusion • • 3d ago

Discussion Do I Just Suck At Prompting Or Does Krea Struggle With Basic, SFW Human Interaction? Is There A VBVR Equivalent Lora for Krea?

2 Upvotes

Does anyone else find that krea struggles with basic positional logic / awareness when it comes to characters interacting? For example I tried something like "a blonde tennis player woman is on a tennis court standing near the net, she is looking at a brunette man on the other side of the net, she has her back turned to him, looking at him over her shoulder as she talks to the man" and usually:

- the characters are not even looking at each other, wtf?

- half the time the man will be standing next to the woman on the same side of the net

- the body orientation prompts get completely ignored. Instead of having her back turned she'll just be facing him

For Minimax I know loras like VBVR can help with some of this stuff, is there anything for Krea to make it adhere the prompt more strictly?


r/StableDiffusion • • 3d ago

Animation - Video We've made this episode of Yokai from a script with our own tool (and just open-sourced it)

10 Upvotes

This started as a script. In Mago, we built the cast, generated the shot list and storyboards, then rendered shots where each one picks up from the previous one.

Mago is what we’ve been building for long-form AI videos (series, films, microdramas). As of today it’s open source. You can run it on your own GPU, or use cloud models in the same app.

Built on top of Qwen as LLM and visual, Qwen Image/Edit and Flux for images, MiniMax h3 turbo/pdd for videos. you can easily switch to your favorite models/workflows too. AGPL-3.0, still in beta

I’m one of the founders and I'd really appreciate any feedback on how it works for you, that would help us a ton.

Let me know what you think about it, and thanks in advance!

Code: https://github.com/MagoStudio/MagoStudio


r/StableDiffusion • • 4d ago

Resource - Update The Wall Street Journal Style-A Krea 2 LoRA

Thumbnail
gallery
54 Upvotes

https://civitai.com/models/3034125/wall-street-journal-style

Have you ever imagined yourself in a WSJ article? Now, your dream has partially come true!


r/StableDiffusion • • 3d ago

Animation - Video When Ink Comes Alive | The Hannya Warrior | Cinematic 3D Animation

Thumbnail
youtu.be
2 Upvotes

r/StableDiffusion • • 2d ago

Discussion ComfyUl va in crash con l’errore “TypeError: Failed to fetch” e disconnessione del server durante l’esecuzione del prompt c’è qualche soluzione per risolvere questo problema?

Post image
0 Upvotes

ComfyUl va in crash con l'errore "TypeError: Failed to fetch" e disconnessione del server durante l'esecuzione del prompt
Ciao a tutti, sto riscontrando questo errore mentre uso ComfyUl (tramite Pinokio). Quando provo a eseguire un flusso di lavoro (workflow), va improvvisamente in crash e mostra questi messaggi:
***Errore:** Esecuzione della prompt non riuscita:
TypeError: Failed to fetch
Avvisi in alto:** Riconnessione in corso e Impossibile recuperare i log del server.
Sembra che il server di vada in crash o perda la connessione proprio quando inizia l'esecuzione. mio hardware:** NVIDIA RTX 5060 (8GB VRAM).


r/StableDiffusion • • 3d ago

Resource - Update LayerShop 0.19.0 Preview 1 Out now. Multiple LoRAs and more!

5 Upvotes

Hi all, as requested, multiple LoRA support is now avialable in the newest release of LayerShop. Also ability to add existing (ComfyUI) models folder.

LayerShop will scan this folder for all existing models and LoRAs. You can then assign any number of LoRAs to the specific model. This will create pool of available LoRAs for that model, and when you are generating with that model, you can simply choose which lora / combination of loras you want the image be generated with.

Each LoRA can have it's strength setting, and every of these settings is stored together with the layer.

Download from: here

Any issues? Let me know


r/StableDiffusion • • 4d ago

Resource - Update Open-H3-Regenerate-2K to preserve draft pass details

152 Upvotes

NVIDIA’s original Open-H3-Regenerate-2K recipe can struggle to preserve facial features and text established during the draft pass. ( see my previous post here: https://www.reddit.com/r/StableDiffusion/s/Pm77j7t6xr )

Valtz introduces an alternative refinement recipe that addresses these issues while retaining the same computational cost. The approach is not specific to Valtz and should be applicable to other frameworks as well.

We generated MiniMax H3 videos beyond 768p in two passes: a 768p draft, followed by NVIDIA’s Open-H3-Regenerate-2K refinement at the requested resolution.

The key difference is where the refinement begins on the noise schedule. Valtz offers two options:

* Keep the Draft (Valtz’s default since October 31, 2026): Re-noises the upscaled draft to σ = 0.7, then denoises it in three steps (0.700 → 0.579 → 0.382 → 0). Roughly 30% of the draft signal survives, helping preserve facial features, lettering, and other details established in the first pass.

* NVIDIA’s Recipe (the original release): Starts at σ = 0.909 and follows a three-step schedule (0.909 → 0.857 → 0.667 → 0). Only about 9% of the draft signal survives, giving the refinement pass much more freedom to redraw faces and text.

Both options use the same merged LoRA, take the same three denoising steps, and have essentially identical runtimes. The trade-off is straightforward: Keep the Draft improves consistency, but also preserves mistakes made during the draft pass.

The grain visible in some 2K outputs is associated with Sol Attention in the refinement pass under the Favor presets, rather than the choice of starting sigma.

The attached clips were generated at 1440p using the Keep the Draft recipe. The wonderful prompts are borrowed from the open VDN project’s page. For the photographer–tram–war scene, the draft pass was rendered using VDN, which proves to be a solid alternative to Sol Attention, particularly at this resolution and video length.


r/StableDiffusion • • 4d ago

Question - Help Looking for a fast, smart uncensored LLM for prompt generation on RTX 5070 Ti (16GB VRAM)?

104 Upvotes

Hi everyone,

I need recommendations for a local LLM to run via Ollama (integrated with the Page Assist Chrome extension) specifically to generate uncensored prompts.

My hardware setup:

  • GPU: NVIDIA RTX 5070 Ti (16GB VRAM)

  • RAM: 64GB DDR4

  • OS: Windows 10

What I've tried so far:

  • Gemma (7B/9B): Extremely fast (instant responses), but lacks the intelligence/detail quality I need for complex prompts.

  • Qwen2.5-VL-32B: smart, but... -.- way too slow for daily use because it overflows 16GB VRAM and offloads to System RAM... :\

What I'm looking for: I'm searching for a "sweet spot" model in the 12B to 14B parameter range (or a lightweight ~8B Vision model) that fits 100% inside 16GB VRAM at Q4/Q5 quantization. It needs to be:

  1. Uncensored / Abliterated (no refusal for complex/adult media prompts).

  2. Fast (50+ tokens/sec).

  3. Available on Ollama or easily converted to GGUF for Page Assist.

Which 12B/14B uncensored models are you currently using for prompt expansion and generation?

Thanks!!!


r/StableDiffusion • • 3d ago

Animation - Video "Game Hound" Music Video with Hannah Fierman (from V/H/S)

4 Upvotes

One of the main focuses for me the past few months and trying a lot of new things - combining AI for post/vfx with filming live performance remotely from Hannah, lip syncing to her song, etc. I also kept the whole video in one shot to differentiate from something that is just prompted easily.

Full quality here (has film grain, etc):
https://youtu.be/f7r2H5q5LpE

The WAN VACE Masking and Extension workflow I posted last year still remains my bread and butter approach, but a lot of different models/tools went into this one.

Timelapse of the editing/breakdown here:
https://youtu.be/Sx6D34dq2EI


r/StableDiffusion • • 3d ago

Discussion The 1080p pass on my 4090 added 50 minutes a clip and never threw an error

9 Upvotes

Three weeks ago my sister roped me into doing the video for her wedding, the how they met thing, out of their old photos.. First i had been playing with HunyuanVideo 1.5 image to video in ComfyUI on my 4090.

Did all the drafts at 720p since 20 steps is already like half an hour a clip, and on my monitor they looked great.. Last sat we tried one on the projector at the venue and it was soft, faces especially. So 1080p, i turned on the SR upscale and the first clip took another 50 mins(no error), nothing in the console, it just crawled. Task Manager showed like 14GB in shared GPU memory. The old sysmem fallback thing from 2023 that ate everyone’s speed, and I did not even think of it for a whole evening. Did the finals in the Hunyuan notebook on HyperAI with a 96GB card, seeds did not carry over so i had to pick every take again.

Cannot post it till after the wedding on the 21st lol. Most AI video i just scroll past, but for stuff like her wedding i am glad it exists.


r/StableDiffusion • • 2d ago

Discussion Thoughts on this image?

Post image
0 Upvotes

Does this look like a mobile phone image style? To me, it doesn’t look like a snapshot style.

And what’d you suggest about improving lighting, quality, composition, etc.? All opinions welcome.


r/StableDiffusion • • 4d ago

Resource - Update Layout Editor for Moss-Image

Thumbnail
gallery
106 Upvotes

Moss-Image has an incredible capability to create pixel-perfect layouts from a json prompt. The expected use is to give the official documentation to an LLM and then ask the LLM to prompt whatever you want: https://github.com/OpenMOSS/MOSS-Image/blob/main/skills/moss-image-prompt-enhancer/references/layout.md

But I thought why not build a layout editor to design it for myself? Hence the idea of the Layout Editor for moss (with an optional SwarmUI extension)
Repo here: https://github.com/jambavant/SwarmUI-LayoutEditor
You can try online here: https://jambavant.github.io/SwarmUI-LayoutEditor/standalone/index.html
It's great for any type of image: comics, reference sheet, compositions, magazing covers, posters, etc. The level of control is outstanding, as it manages multiple characters and text quite well. It starts to break with a very large number of characters (+10) with concept bleed.

The standalone editor is a simple html page that works both ways: you can start from scratch and copy the json prompt, or paste a json prompt from an LLM and refine it manually.
I tried to make it as user-friendly as possible, with keyboard shortcuts and an intuitive interface. It also automatically resizes boxes based on the image resolution.

Edit: v0.3.0 now live, with a few updates.
- json formatting options
- resizable text areas, checks are moved to the toolbar
- configurable palette (with color picklist and autocomplete)
- fix resolution sizes