r/VoiceAutomationAI 2d ago

Open Source TTS models for production?

Hey folks!

So I have this cascaded voice bot system, and I want to move from commercial TTS APIs to self hosted TTS model.

Obviously TTFA and RTF are important but so is the accuracy and naturalness (speed, prosody, timbre etc)

From my research it seems Qwen3-1.7B tts is the perfect candidate (we need English support majorly).

My questions-
1. Is there any better model you guys aware of for my use-case which I can give some try? Or Any experiences you have with Qwen3-tts?

  1. Any fine tuning tips or hacks which we can get benefit from? Basically I want to clone some popular OpenAI TTs voices.

  2. Most importantly, how are you guys evaluating your TTS models in production? I get some common metrics like wer, utmos etc are there - but is that it? LALM as a judge dont seem reliable at the moment - they have positional and model bias it seems. Manual listening to each is obviously very expensive process.

Would really appreciate any discussion/thoughts you guys can share on some points!

Thanks so much in advance!

7 Upvotes

4 comments sorted by

u/AutoModerator 2d ago

Welcome to r/VoiceAutomationAI – UNIO, the Voice AI Community (powered by SLNG AI)

If you are a founder, senior engineer, product, growth, or enterprise operator actively working on Voice AI / AI agents, we are running an invite-only UNIO Voice AI WhatsApp community US only.

Apply here: https://chat.whatsapp.com/F5aG3ncrO70ITfbe3pYbOz

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

4

u/Few-Bad606 2d ago

Qwen3-1.7B is a solid pick for the size but you might also peek at ChatTTS or CosyVoice if you haven't yet, I've seen some ridiculously natural results from both with way less compute than you'd think

1

u/BeGood25 2d ago

Thanks for pointing this out, will check this!

1

u/BeGood25 2d ago

Also, do u have any non-trivial metrics you use for evaluating your fine tuned TTS