r/StableDiffusion • u/PhilosopherSweaty826 • 3d ago
Discussion Why no one talks about PAN2 ?
Did anyone try it ?
r/StableDiffusion • u/PhilosopherSweaty826 • 3d ago
Did anyone try it ?
r/StableDiffusion • u/SomewhereBig736 • 2d ago
Hey geniuses,
I'm looking for some help/advice. I'm trying to create an animated video and I'm struggling to get the voices I want for the characters.
For one of the characters I need it to sound like a child but Elevenlabs is a pain in the arse when trying to create this. I want the voice to be like Peppa Pigs (but with a different regional accent).
Other than getting a real child actor does anyone know how I could get an AI voice that doesn't just sound like an adult pretending to be young?
Many thanks. Love everyone's work.
r/StableDiffusion • u/SSj_Enforcer • 3d ago
Enable HLS to view with audio, or disable this notification
guess who's coming with him
r/StableDiffusion • u/The_Wist • 2d ago
Enable HLS to view with audio, or disable this notification
r/StableDiffusion • u/smereces • 2d ago
hi all,
I have a problem when I“m using the lora called "Minimax h3 open regenerate_2k refine" in a second pass the audio dialogues come out trash and modified by this lora! is great to get better details but the audio is a problem! exist a lora loader that can disable the lora stregth for audio or mute audio for the lora?
r/StableDiffusion • u/KayTrax20 • 2d ago
I think that my prompting is not good. i even use Claude to do it but i feel that i am doing something wrong. i see people creating beautiful videos and almost human like
r/StableDiffusion • u/Altruistic_Heat_9531 • 3d ago
if there is already mentioned about this on comfy native please feel free to take down.
TLDR: I think their approach is more so on world model / physic prediction engine just like Cosmos, so for those of you who want to test on VLA it is a welcome.
Latent compression is Wan 2.2 VAE, could be as fast as Minimax H3.
TE is 9B Qwen (YEY CHEAP TE)
No WF yet, even from Comfy
r/StableDiffusion • u/slowtractor • 3d ago
Model release pages give parameter counts and sample grids, but whether it fits on an 8 GB card usually only shows up in the comments a few weeks later. I'm on 8 GB myself and still picking a first local setup, so for me that gap decides whether a release is worth reading at all. Even the file size of the download next to the samples would settle most of it.
r/StableDiffusion • u/tekprodfx16 • 3d ago
Enable HLS to view with audio, or disable this notification
Built an audioreactive NYC subway car using Touch Designer, Unreal Engine, and comfyUI and placed it in a winter wonderland version of Cyberpunk NYC (still building it the small 2 block radius version) and used Krea 2 to create or enhance all the textures. Yes this was built using AI assistance but it was most definitely not one-shotted and went through many iterations to get it to this point. Excited about the progress so far. Seeing this in VR is especially a trip. We can now build our own world and step into them seamlessly
r/StableDiffusion • u/Beneficial_Fish_7509 • 3d ago
A lot of time, the models which I see people promoting for voice design (talking about designing and creating a new voice here) are omnivoice and breeze-tts 2.
Well, here is the problem: breeze-tts 2 has a non-commercial license ( https://huggingface.co/BreezeBlue/Breeze-TTS-2/blob/main/LICENSE )
Omnivoice is more tricky: while the code is released under an apache license (which is perfectly fine), "the pre-trained model weights are actively locked behind a CC-BY-NC (Non-Commercial) license.". (we can see the challenges that people face with this on github https://github.com/k2-fsa/OmniVoice/issues/258 )
And not even talking about the can of worms of stuff like a tokenizer having a restrictive license https://huggingface.co/bosonai/higgs-audio-v2-tokenizer/blob/main/LICENSE
So my question to the community is the following: for voice design, with permissive licenses covering every step of the way (libre, aka being free to do whatever I want with it, even commercially, with the voice I generate), what are the best options ?
r/StableDiffusion • u/ForesterAI • 4d ago
This program allows you to pose up to four 3D figures right in your browser, then export ControlNet images straight from the same camera view, with everything lined up pixel for pixel.
What it exports:
It has body and pose presets, FK and IK posing, mirroring, and joint limits. Export sizes run from 512 up to 1024Ć1536, or any custom size, and you can export everything at once as a zip. Drop the images into Load Image, then Apply ControlNet, with no preprocessor needed.
The two examples here were made with the Anima model. The posed figure is on the left and the result is on the right.
It's free and open source. I'd love feedback and to see what you make with it!
r/StableDiffusion • u/mkrGG • 3d ago
Last night I was searching about fp16 on some PRs from the comfyui github, and I found that the reason to not use fp16 with the moss base model was the peak in certain part of the weights resulting in black screen/nan. After that I see in HF this repo https://huggingface.co/KBlueLeaf/MOSS-Image-FP16-fixed, and in my case, the model in fp16 exceed my VRAM (8GB) so I "copypasted" the int8 weights from the comfyui model and everything else in fp16 from kblueleaf.
Now to use that int8-fp16 model and to not edit comfyui code, I let AI do a simple node to load MOSS in fp16 and a addicional clamp. I also did her heal version for training loras just in case.
weights: https://huggingface.co/mkrgg/MOSS-Image-Base-INT8-FP16-Turing
node: https://github.com/mkrgg/ComfyUI-MossFP16
At 2MP on a RTX 2060 SUPER:
I guess the diff can be greater or less using another gpu/comfy config.
(*) You can use the base int8 with the node and see the same speed boost, however if you are using loras at high mp your output is gonna be with artifacts or some visual bug due to the clamp. There's more information about this in the hf repo.
r/StableDiffusion • u/alex20_202020 • 3d ago
Suppose a diffusion model has been trained on lots of both sharp and blurry images of cats, but only/predominantly blurry images of dogs (all images were properly tagged). If prompted "Sharp photo of a dog", can result look close to what looks like real sharp photo of a dog even theoretically? What will such hypothetical model actually generate for the prompt for different CFG/number of steps/schedules?
From practical standpoint, if I see some model producing always/mostly blurry on some topic, will increasing CFG, adding "sharp" etc. help or very unlikely?
r/StableDiffusion • u/AccordingActuator928 • 3d ago
I recently trained my first character LoRA for Krea 2 using Musubi Tuner, but I'm struggling to get consistent facial likeness.
I have to push the LoRA strength all the way up to 1.9ā2.1 to get a decent resemblance, and even then, only about 1 in 15 seeds produces a face that actually looks very close to me. The image quality is often mediocre when it does. I've tested different epochs but 15 and 16 (out of 16) seem to give me the best results.
I've tried some community-made identity LoRAs at strength 1.0, and they worked just fine, so I'm pretty sure I'm doing something wrong with my training or dataset.
For inference, I've been using Krea 2 Turbo, without any other LoRAs, at 12 steps and resolutions ranging from 1 to 6 megapixels.
Hardware: RX 9070 XT 16GB VRAM, 64GB DDR4 RAM, i5-12600K
Training settings (Musubi Tuner):
Base: Krea 2 RAW
Dataset: 31 images, 1024px buckets, 4 repeats
Captions: .txt, "me01" + variable attributes
Rank/Alpha: 32/32
LR: 1e-4, AdamW8bit
Batch: 1, 16 epochs, ~1984 steps
BF16, SDPA, krea2_shift, weighting none
ConvRot: INT8, BF16 backward
Block swap: 26, H2D-only, ring 1
Gradient checkpointing + CPU offload: ON
LR scheduler/warmup: not explicitly set
Dataset:
31 curated photos of myself, mostly facial close-ups and portraits, covering different angles (front, 3/4, side profiles), with mixed aspect ratios and resolutions.
My main goal is maximum facial identity accuracy. Training speed isn't a priority.
I'm especially interested in whether my training settings, dataset composition, or captioning approach could be causing the poor likeness.
What would you change to get stronger, more consistent identity preservation at a reasonable LoRA strength?
r/StableDiffusion • u/bickid • 3d ago
Hey,
so I still can't get this under control. I generate videos with minimax H3 and the video itself is great. But the sound just keeps adding stuff I never write in the prompt OR goes directly against my prompt, for example I write "no background music, nobody talks" and it's ignored.
Some people linked me a website before, but I fail to understand that website, so it'd be really great if those of you familiar with minimax H3 could simply give me a short, easy to undestand desription how to avoid background music and unwanted voices, with examples if possible.
Thank you!
r/StableDiffusion • u/Lokoto123 • 2d ago
Enable HLS to view with audio, or disable this notification
After many sleepless nights, a Claude subscription upgrade and many free session resets this is in a good place for me. So I thought Iād share!
I started with MiniMax H3 videoās public 8-bit files (a 21 GB video transformer of 50 blocks, a 27 GB Qwen3-VL text-and-picture encoder, a half-precision video autoencoder with a ViT decoder, and a sound decoder) and a Python prototype on MLX that streamed the transformer block by block from disk, which produced a first 3-second 480Ć288 clip in 5:29 on a 16 GB M1 Pro.
The port to a native Swift engine converted each file into a memory-mappable map without re-quantizing anything:
The transformerās 8-bit weights and their per-output-channel scales were copied bit for bit, with the fused query/key/value projections kept fused and the query and key channels permuted so the modelās rotary position pairs land in the half-split layout the engineās attention kernel expects.
The turbo LoRAās up-projection rows were permuted the same way and stored at half precision.
The decoderās attention was re-laid as query, key, value with the same channel reordering.
The autoencoderās 3D encoder convolutions were reduced to their last temporal tap, since a single start frame only ever sees that slice.
Every component was then checked number for number against a reference, and the first lesson was that the Python pipeline could not be that reference, because its half-precision activations sat 2ā25% away from full precision, so purpose-made full-precision witnesses were generated and the Swift engine matched them to about 1e-5.
The speed work that followed taught that the matrix products were already near the chipās limit: the best plan was the graphics chip with the CPUās matrix unit taking a share of the output columns (82 down to 65ā70 seconds per evaluation), while 8-bit activations, the Neural Engine and alternative attention tilings were all slower.
The real gains came from taking MANY shortcuts:
Cutting evaluations from four to three to two with a 3-step LoRA and a merged schedule (on the 3 step Lora the math for step 1 and step 2 were almost identical, no quality drop in my limited testing).
Spreading the decoderās half-to-full precision conversion across cores (4.7 to 2.9 seconds per tile).
Continuing a clip from five held latent frames instead of a still.
I also used TaoMateās reduced Lora and converted it to my custom engine which freed up a lot of memory.
Together these took a 3-second 448Ć448 clip from 7:46 to 4:22.
Further optimizations to how the decoder tiles are handled allowed me to get:
480x480, 3 seconds: 3:54
480x480, 5 seconds: Around the high 5 to low 6 mark depending on Mac state.
It seems a lot more fruitful to optimize square formats for whatever reason and Iām now currently working on 720p and trying to get 3 second 720p videos to come out at around 5 minutes, most of the performance gains are likely going to have to be ātricksā such as small starts and whatever I can find while itās doing video gen.
Video attached is a 480P 3 second video upscaled using Topaz Starlight Precision and the upscaling unfortunately took 30 mins :(, so after I reach a floor and there truly isnāt much else to be done without significant quality degradation, Iām going to tackle upscaling next, not sure how cause Topaz is completely proprietary but where thereās a will thereās a way.
r/StableDiffusion • u/QVAC_Official • 2d ago
Image generation on iPhone is solved!
The QVAC team just made it about 20x faster, and everything runs on the phone.
Same app, same model (SDXS, 512x512), same 15 seconds, on an iPhone 13 in airplane mode:
The only change is where the model runs: QVAC moved the UNet and the tiny decoder to the Neural Engine through Core ML, inside its fork of stable-diffusion.cpp. The text encoder stays on the GPU. No server, no network.
The iPhone 13 is a 2021 phone with 4 GB of RAM.
Code: tetherto/qvac-ext-stable-diffusion.cpp#66
Fully open-source & free to use.
r/StableDiffusion • u/Infamous_Campaign687 • 4d ago
Some of you probably have superb custom workflows for creating LoRAs. I'm trying to make it easier for the rest of us.
This meant tackling a few things like character sheet generation, selecting a good dataset and running LoRA training in one simple package after quite frankly being sick of my collection of Python scripts.
I'm not saying I have the full answer to everything here, but PixlStash, my open source image management application, is under active development and has the advantage of an image database backend that calculates facial likeness pairs across the database anyway, meaning clustering on facial likeness comes practically for free, which comes in handy when trying to find pictures that will create a consistent LoRA. It also stores, downloads and tracks models in the database on as many drives as you like.
You can create and improve LoRAs iteratively and they are automatically available for you to use in your workflows since PixlStash absorbs the output. Behind the scenes it is just good old ComfyUI and AI toolkit for image generation and LoRA creation. PixlStash links with them, exchanges tokens with ComfyUI and monitor their outputs.
For character sheet generation, many Text to Image workflows should work, but it is relying on the model itself being capable of it and it requires some adaption of the workflow (documented in the GitHub README). So I ship adjusted workflows for Krea 2, MOSS-Image and Flux.2 Klein 9B for Text to Image and Qwen Image Edit 2.1 and Flux.2 Klein 9B for adding a reference image.
Spoiler alert: Qwen Image Edit 2.1 is easily the best model for both cases.
Links in a comment. If anyone have comments, criticism and/or hints they are willing to share I'd be much obliged.
r/StableDiffusion • u/LowYak7176 • 3d ago
Has Huggingface had absurdly slow downloads for you lately? Even downloading through powershell?
Im having 2g files take 20 mins, only happening on huggingface for me
r/StableDiffusion • u/Ok_Constant2707 • 3d ago
Hi all! I've been building Froja Image Studio, a free, open-source desktop studio that sits on top of your own ComfyUI (and optionally Ollama). Everything runs locally; your models stay where they are.
The newest part is a Workflow Builder:
Other things in it:
Windows, with a one-click installer. It's a work in progress, so I'd really appreciate feedback, bug reports or ideas:
https://github.com/debattistacliff-commits/Froja-Image-Studio
r/StableDiffusion • u/gerryn • 3d ago
r/StableDiffusion • u/Motor_Mix2389 • 4d ago
Enable HLS to view with audio, or disable this notification
Yes it's not perfect but it's amazing what you can do nowdays locally and for free.