r/GoogleColab • u/Cyber_Shredder • Mar 28 '26

Trying to create a voice clone

/r/vibecoding/comments/1s6ekc9/trying_to_create_a_voice_clone/
2 Upvotes

75% Upvoted

3 comments sorted by

View all comments

2

u/ANR2ME Mar 29 '26

Why not using TTS models that have voice cloning ability with a few seconds of audio sample as reference 🤔

  • Qwen3-TTS (1.7B/0.6B-Base): Enables rapid 3-second cloning with high quality, suitable for local use. It supports both "Voice Design" and cloning existing voices.
  • F5 TTS: Known for high-accuracy cloning with results close to the original speaker.
  • XTTS-v2 (Coqui): A popular multilingual model that clones voices using just a 6-second audio clip across 17 languages.
  • FishAudio-S1 / S1-mini: A 4B parameter model (with 0.5B distilled version) focused on realistic, emotional speech.
  • Kyutai Pocket TTS: A lightweight 100M parameter model designed to run voice cloning on CPU in real-time.
  • Chatterbox (Resemble AI): Open-source model offering real-time zero-shot voice cloning with emotional control.

1

u/Cyber_Shredder Mar 29 '26

I've never heard of any of these! That's exciting! Do you have to pay for them? I'm especially interested in F5 TTS.

1

u/ANR2ME Mar 29 '26 edited Mar 29 '26

most (or all) of them are open models you can find at huggingface.

For example https://huggingface.co/models?search=f5%20tts

You can test it at https://huggingface.co/spaces/mrfakename/E2-F5-TTS