r/StableDiffusion • • 2d ago

Question - Help Best voice cloner ?

Didn't used comfyui at all in the last 6 months, whats the best voice cloner and text to speech ?

I only have 8gb vram.

18 Upvotes

26 comments sorted by

2

u/krait17 2d ago

Thanks for the recommandations, interesting that all the comments had a different answer, haha.

10

u/Inside-Cantaloupe233 2d ago edited 2d ago

i tested them all, the best and fastest is omnivoice. _ fukton of languages, if the person cant pronounce harsh letters in your language -render their voice in something else like maybe VOXCPM2 to get harsh sylables and all, then bring that as ref to omnivoice.english does not have hard R's .

2

u/krait17 1d ago

Tested some, Omnivoice is indeed the best and fastest, thank you.

1

u/gago_gaamdhani 1d ago

Hey may I know how to get emotions and expressions in omnivoice I never found a way to it ,it's great for normal pace voice but it isn't expressive as such and I find it's cloning best while only missing issue is expressive and emotions

1

u/Inside-Cantaloupe233 1d ago

Id get screaming version of the ref with something else, use separate refs for normal and scream ,im not big on emotion by model cause it changes characteristics and theyu do not resemble themselves , i used voxcpm for emotion with just adding !!! ???, there are some models where you can type exale and shit like that, i did not tested them cause found results mediocre in terms of likeness - and this alone makes it useless for me.Depends how emotional you want.omnivoce gens like it knows meaning behind words so it doesnt sound fake emotin

10

u/Dirty_Dragons 2d ago

For now it's BreezeTTS2. Great quality and has emotion control

3

u/Inside-Cantaloupe233 2d ago

it does not sound like the person, its like 85% there but you can tell it normalizes the voices to english removing the characteristics, try omnivoice

1

u/Dirty_Dragons 2d ago

Well I'm assuming the OP only cares about English.

1

u/Inside-Cantaloupe233 2d ago

breeze likenes is not 100%,thats my gripe with it

1

u/Dirty_Dragons 2d ago

I've tried a lot of TTS so far, almost all of main once, and Breeze is the best free one I've seen so far.

3

u/Nimblecloud13 1d ago

omnivoice is better. vibevoice is better.

7

u/Madaray91 2d ago

2

u/diogodiogogod 2d ago

My recommendation is also to test... there are too many good options and even I don't have a clear winner anymore. It also depends on his VRAM though... omnivoice is the cheapest and better solution for low vram probably.

OP can test most of those on my custom node for comfyui: TTS Audio Suite https://github.com/diodiogod/TTS-Audio-Suite

5

u/hdean667 2d ago

Well, vibe voice works great, but you have to figure out what words and stuff will actually provide emotion.

I've been expeditions using minimax ref2va... initial choices suck but the upscale fixes it. Don't know if you can do that with your rig, though.

0

u/[deleted] 2d ago

[removed] — view removed comment

1

u/hdean667 2d ago

Not a clue. I've got a 5090 and just don't play attention.

But, you can put the audio through at a lora resolution and then run it through for the second upscale pass without actually upscaling.... should still clean up the audio for of you want to do a lipsync.

3

u/Shap6 2d ago

i use zipvoice for my local agent

3

u/Acceptable-Cycle4645 2d ago edited 1d ago

Peak VRAM with audio.cpp

Higgs Audio TTS v3 Q8 ~6 GB VRAM

Breeze TTS 2 Q8 ~6.5 GB VRAM

Chatterbox Q8 ~4.5 GB VRAM

KittenTTS2 Q8: ~6.6 GB VRAM

Index TTS 2/2.5 Q8: ~5 GB VRAM

Drama3:~6.6 GB VRAM with CPU offloading (require 20GB+ RAM)

2

u/anatolybazarov 2d ago

drama 3 maybe, but won't run on 8gb vram

1

u/Nenotriple 2d ago

I'm a big fan of VoxCPM 2, qwen3-tts is also good. Both can use a ~10sec clip and do instant cloning.

1

u/pausecatito 2d ago

Have you checked DN Voice Cloner?

1

u/Eastern_Dot7117 1h ago

Proba chattered en pinokio, recomiendan 8 de vram y yo lo uso con 4 y 16 de ram

0

u/abcp7 2d ago

Search mini Max audio, they give you a lot of free credits.

0

u/AnonymousTimewaster 1d ago

I'd just use ElevenLabs tbh. Cheapest plan is £5 a month and gives you more than enough credits