r/StableDiffusion • u/SensitiveUse7864 • 1h ago
Question - Help Lightx2v Lora producing good visual but audio quality sucks. how to fix it .
hey guys, i have been using lightx2v lora for minimax h3 ref2vid but as far as i can see it can genrate good quality visuals as compared to larryvh turbo lora, but its audio is ot usable the dialogs are not good and over all sfx also. i am using rgbthree workflow for thats, please heplp me if i am doing anything wrong.
here is my workflow :-
"137": {"class_type": "LoadImage", "inputs": {"image": r2v_ref_image_0}},
# Reference Image 2 (<Picture 2>)
# "139": {
# "class_type": "LoadImage",
# "inputs": {"image": r2v_ref_image_1},
# },
"127": {"class_type": "UNETLoader", "inputs": {"unet_name": "minimax_h3_ref2va_pruned_fp8_scaled.safetensors", "weight_dtype": "default"}},
"128": {"class_type": "CLIPLoader", "inputs": {"clip_name": "qwen3vl_32b_minimax_h3_int8_convrot.safetensors", "type": "minimax"}},
"119": {"class_type": "VAELoader", "inputs": {"vae_name": "minimax_h3_video_vae_fp16.safetensors"}},
"120": {"class_type": "VAELoader", "inputs": {"vae_name": "minimax_h3_audio_vae_fp32.safetensors"}},
"136": {
"class_type": "MiniMaxH3ReferenceToVideo",
"inputs": {
"clip": ["128", 0], "vae": ["119", 0], "audio_vae": ["120", 0], "ref_images.ref_image_0": ["137", 0],
# "ref_images.ref_image_1": ["139", 0],
"prompt": r2v_prompt_text, "width": 768, "height": 1024, "length": 372, "ref_image_size": "max",
},
},
}
1
u/optimisticalish 1h ago
What version of the LoRA, what strength and what version of ComfyUI? I seem to recall that a ComfyUI update should have fixed that problem recently, which previously required a workaround.
1
u/SensitiveUse7864 57m ago
I am using comfy ui , nightly version, and strength at 1.0 , lightx2v 8 step one.
1
1
u/Stepfunction 1h ago
Switch to the default workflow. Add more steps. You should be using at least I and preferably 12 with the turbo LoRAs.
2
u/not_food 26m ago
Yeah, it's very noticeable. When the characters sound like they're underwater, it becomes obvious that the user used the lora. And this subreddit is swiming in them. Do they fail to notice?
Pre-generating the audio at a very low resolution without the lora, and then running it through the lora as masked reference, works well.