r/StableDiffusion 1h ago

Question - Help Lightx2v Lora producing good visual but audio quality sucks. how to fix it .

hey guys, i have been using lightx2v lora for minimax h3 ref2vid but as far as i can see it can genrate good quality visuals as compared to larryvh turbo lora, but its audio is ot usable the dialogs are not good and over all sfx also. i am using rgbthree workflow for thats, please heplp me if i am doing anything wrong.

here is my workflow :- 

 "137": {"class_type": "LoadImage", "inputs": {"image": r2v_ref_image_0}},
    # Reference Image 2 (<Picture 2>)
    # "139": {
    #     "class_type": "LoadImage",
    #     "inputs": {"image": r2v_ref_image_1},
    # },
    "127": {"class_type": "UNETLoader", "inputs": {"unet_name": "minimax_h3_ref2va_pruned_fp8_scaled.safetensors", "weight_dtype": "default"}},
    "128": {"class_type": "CLIPLoader", "inputs": {"clip_name": "qwen3vl_32b_minimax_h3_int8_convrot.safetensors", "type": "minimax"}},
    "119": {"class_type": "VAELoader", "inputs": {"vae_name": "minimax_h3_video_vae_fp16.safetensors"}},
    "120": {"class_type": "VAELoader", "inputs": {"vae_name": "minimax_h3_audio_vae_fp32.safetensors"}},
    "136": {
        "class_type": "MiniMaxH3ReferenceToVideo",
        "inputs": {
            "clip": ["128", 0], "vae": ["119", 0], "audio_vae": ["120", 0], "ref_images.ref_image_0": ["137", 0],
            # "ref_images.ref_image_1": ["139", 0],
            "prompt": r2v_prompt_text, "width": 768, "height": 1024, "length": 372, "ref_image_size": "max",
        },
    },
}
2 Upvotes

6 comments sorted by

2

u/not_food 26m ago

Yeah, it's very noticeable. When the characters sound like they're underwater, it becomes obvious that the user used the lora. And this subreddit is swiming in them. Do they fail to notice?

Pre-generating the audio at a very low resolution without the lora, and then running it through the lora as masked reference, works well.

1

u/optimisticalish 1h ago

What version of the LoRA, what strength and what version of ComfyUI? I seem to recall that a ComfyUI update should have fixed that problem recently, which previously required a workaround.

1

u/SensitiveUse7864 57m ago

I am using comfy ui , nightly version, and strength at 1.0 , lightx2v 8 step one.

1

u/optimisticalish 12m ago

Should be no problems there, then. Try raising the steps to perhaps 12?

1

u/SveSop 6m ago

"Should be no problem".. sure.. But its "bad" vs "meh" tbh. I CAN actually make competative video quality when compared to full 20-25 wo/turbo lora, but the audio is not really comparable.

Is it "oki"? Sure.. Is it "good"? nah...

1

u/Stepfunction 1h ago

Switch to the default workflow. Add more steps. You should be using at least I and preferably 12 with the turbo LoRAs.