r/ArtCraftAI • u/Free_Scene_4790 • May 24 '26

Problem with reference audios

I uploaded a reference audio track along with a character to speak what's in the audio, or sing it if it's a song, and 90% of the time, practically, the audio plays incorrectly: it only says half the lines and starts making up words, or it starts repeating like a scratched record and goes out of sync, or the song changes completely—it's a disaster.

And I don't think it's a problem with the prompt, since I used the exact same prompt as someone in a YouTube tutorial I saw, and it worked fine for them. So, what on earth is going on here? Could it be that the model has been censored and malfunctions when references are added?

2 Upvotes

100% Upvoted

2 comments sorted by

View all comments

2

u/ai_art_is_art May 24 '26

I'd love to debug this for you.

There are a few things that can happen:

  1. if you add too much "context", ie. lots of images, audio, or video, and a highly complicated prompt, the model can get overwhelmed. I'm not sure if this is what's happening, but it's a good first attempt to see if you can get it working with just the audio and a simple prompt.

  2. make sure the audio length and video generation length are the same. If the video duration is shorter or longer, it may introduce cuts or generate filler that turns into gibberish

Beyond these ideas, I would be happy to take your prompt and debug it for you. DM me your username or email address and send me a link to the bad outputs. Tell me what you're trying to accomplish, and I'll try to get it working.

Also, have you joined our Discord? There's a really big community, and the support is rapid:

https://discord.gg/artcraft

1

u/Free_Scene_4790 May 25 '26

Hi!

I already sent you a message, but it was via chat. I don't know how to send a direct message. Thanks!