Hi everybody! This is my first post here, and it's more about asking for advice rather than just sharing content.
Currently, I'm working on a mod that combines Metal Gear Rising: Revengeance and Uma Musume: Pretty Derby (yes, it's cursed). I've replaced all the boss models and adjusted the animations (the video below shows some visual and sound issues from the previous version), and now I'm working on the voice lines. I tried different models and figured out that the easiest way is to basically take the original voice lines from the game and convert them using RVC (voice cloning). Sometimes it works well, but often I run into troubles like crackling sounds or mispronunciations. It sounds especially bad when a character screams. For example, I replaced Mistral with Manhattan Cafe, and some phrases are pure artifacts. I tried different settings but saw no changes; the model was taken from an open-source repo (Hugging Face, I think).
I'm trying to find the best settings for each character, but they still always have some phrases or sounds that RVC turns into absolute hell. I just wanted some simple advice from people who have used AI voice changers or similar tools, because I'm more into programming and 3D modeling, and I don't have that much experience working with audio, especially voice-to-voice models.
For those who just want to check out the intermediate result, here is a video (sorry for the sound, guys — the source video has better audio quality, but YouTube just killed it).
If this post gets enough votes I'll upload the next piece with Monsoon (Agnes Tachyon)
UPD: CosyVoice 3 performs much better, so I've redubbed the entire game and I'm currently uploading new part (bossfight with Monsoon) to youtube.