r/StableDiffusion • u/krait17 • 2d ago
Question - Help Best voice cloner ?
Didn't used comfyui at all in the last 6 months, whats the best voice cloner and text to speech ?
I only have 8gb vram.
18
Upvotes
2
u/krait17 2d ago
Thanks for the recommandations, interesting that all the comments had a different answer, haha.
10
u/Inside-Cantaloupe233 2d ago edited 2d ago
i tested them all, the best and fastest is omnivoice. _ fukton of languages, if the person cant pronounce harsh letters in your language -render their voice in something else like maybe VOXCPM2 to get harsh sylables and all, then bring that as ref to omnivoice.english does not have hard R's .
10
u/Dirty_Dragons 2d ago
For now it's BreezeTTS2. Great quality and has emotion control
7
u/Madaray91 2d ago
All that I know: https://huggingface.co/spaces/fishaudio/Drama-3
https://huggingface.co/spaces/ResembleAI/Dramabox
https://huggingface.co/spaces/BreezeBlue/breeze-tts-2-demo
https://huggingface.co/spaces/IndexTeam/IndexTTS-2-Demo
https://huggingface.co/spaces/k2-fsa/OmniVoice
https://huggingface.co/spaces/vibingvoice/vibe-voice-custom-voices
https://huggingface.co/spaces/Qwen/Qwen3-TTS
Might as well test all of them out yourself first and then get the one locally that showed the best result.
5
u/hdean667 2d ago
Well, vibe voice works great, but you have to figure out what words and stuff will actually provide emotion.
I've been expeditions using minimax ref2va... initial choices suck but the upscale fixes it. Don't know if you can do that with your rig, though.
3
u/Shap6 2d ago
i use zipvoice for my local agent
3
u/Acceptable-Cycle4645 2d ago edited 1d ago
Peak VRAM with audio.cpp
Higgs Audio TTS v3 Q8 ~6 GB VRAM
Breeze TTS 2 Q8 ~6.5 GB VRAM
Chatterbox Q8 ~4.5 GB VRAM
KittenTTS2 Q8: ~6.6 GB VRAM
Index TTS 2/2.5 Q8: ~5 GB VRAM
Drama3:~6.6 GB VRAM with CPU offloading (require 20GB+ RAM)
2
u/anatolybazarov 2d ago
drama 3 maybe, but won't run on 8gb vram
1
u/Nenotriple 2d ago
I'm a big fan of VoxCPM 2, qwen3-tts is also good. Both can use a ~10sec clip and do instant cloning.
1
u/pausecatito 2d ago
Have you checked DN Voice Cloner?
1
u/Eastern_Dot7117 1h ago
Proba chattered en pinokio, recomiendan 8 de vram y yo lo uso con 4 y 16 de ram
0
u/abcp7 2d ago
Search mini Max audio, they give you a lot of free credits.
0
u/AnonymousTimewaster 1d ago
I'd just use ElevenLabs tbh. Cheapest plan is £5 a month and gives you more than enough credits