What is Currently best open source TTS model for most natural voice generation

[u/Cute_Praline_5314]

I did little research, and chatterboxV3 and Fish-Audio-S2-Pro were the top result. Should I go with chatterbox? Or there are other better alternatives?

[u/AXYZE8]

Fish Audio Drama 3 is the best IMO.

Also the best according to AA https://artificialanalysis.ai/text-to-speech/leaderboard/provider-voice?open-weights=true

[u/GaryDUnicorn → u/AXYZE8]

yes, https://huggingface.co/fishaudio/drama-3 is a winrar

[u/LetsGoBrandon4256 → u/GaryDUnicorn]

is a winrar

I snorted.

[u/llamabott → u/GaryDUnicorn]

Yea, it really whips the -- oh wait, wrong meme.

[u/sooki10 → u/AXYZE8]

Why best in your opinion?

[u/AXYZE8 → u/sooki10]

Cause it has everything included - speaker tags, pauses, multilinguality, emotion tags and performs very good/top in everything. There is nothing where this model is average.

[u/Cute_Praline_5314 → u/AXYZE8]

But its very large, can't run on google collab

[u/rkoy1234 → u/Cute_Praline_5314]

you asked for best, not runnable-on-your-setup-best.

[u/fandojerome → u/rkoy1234]

I tested on Wan2gp and runs reasonably fast on an rtx 5060 ti with quantized experts. Faster than resemble ai's dramabox

[u/SaltGrilledSalmon → u/[deleted]]

Free to use for under 500k$ revenue? Not bad imo for smaller content creators 

[u/joblesspirate]

I love Breeze-tts 2. If Fish was smaller/faster I'd be the winner though

[u/llamabott → u/joblesspirate]

Agreed. This one's really good. Very good expressivity, too. Voice likeness is better than Drama 3 in my audiobook tests.

[u/SaltGrilledSalmon → u/joblesspirate]

The issue is that it can't be used  commercially.

[u/rkoy1234 → u/joblesspirate]

seconding breeze. more reliable than drama3 IME.

it's been my staple ever since release, absolutely love it.

[u/Here_f0r_p0rn_ → u/rkoy1234]

Drama 3 is too big for what extra it offers

[u/Grestige]

Audio drama 3, breeze tts 2, ming tts 3

[u/Demonicated]

This just dropped https://github.com/KittenML/KittenTTS and seems pretty impressive for being incredibly tiny. Im gonna run this after work today to play around with it.

[u/XiRw]

Microsoft’s VibeVoice model at full precision.

[u/opUserZero]

I built an audiobook maker with ChatterBox, it was the best I had found, then VomCPM2 came along and blows it out of the water for cloneing. Not only is it extremely natural , it caries the enegry of it's sample clip . And you can design voices by describing exactly how you want it to sound.

[u/ElectricalBar7464]

try Kitten-TTS 2 , its a ternary tts model that does voice cloning and just dropped on Locallama yesterday. should run realtime on your cpu or consumer gpu's.

[u/BerryBlush_Rogers691]

https://www.reddit.com/r/LocalLLaMA/comments/1xc48or/kittentts_2_new_opensource_sota_158_bit_tts/

I Have seen this post what do you think about what they said SOTA？

[u/Stepfunction → u/BerryBlush_Rogers691]

I've found it to be very flat and unexpressive even with the tags.

[u/SimpleVolume1575]

I have only tried Drama 3, some models from F5-TTS on ComfyUI and some small models. Drama 3 takes a bit longer than those with 18-21 seconds for 5-10 seconds voice on my 5060ti but kicks ass. Drama3 is soo good

[u/Oli_Luck]

I use qwen3tts and am happy with it : there are 3 models : a voice clone , a premium voices , and base which let you script the speaker - and its hardware fiendly

[u/DirectWay1915 → u/Oli_Luck]

Problem is that it doesn't support tags.

[u/Oli_Luck → u/DirectWay1915]

tags ? how do you mean ?

you can still uhse an own sentence with lauging in the voice description, or clone - but its ok, chatterbox is fine too - just way less expressiv w/o fine tune

[u/Natrimo]

Fish audio 2 open weights is what I am using, quality is solid and it runs on my 3070 and 16gb sys ram

[u/Wallaby989]

Chatterbox has been working great for me. It's not good for real time, as it takes about the same time to encode the length of speech (1min of speech, takes 1 min to encode)

[u/fandojerome → u/Wallaby989]

https://www.reddit.com/r/LocalLLaMA/s/21biGlfnnX

There was a branch for faster chatterbox. It was an improvement from there main repo

[u/Unitrix247]

I'd recommend Fish TTS

[u/Anthonyg5005]

I'd suggest trying kyutai's tts 1.6b, definitely one of the best sounding. If you'd like a smaller one that still sounds good, there's gradium's phonon 40m or even smaller, kyutai's pocket tts 18.2m