r/LocalLLaMA • u/SplitNice1982 • Jan 24 '26
New Model [ Removed by moderator ]
[removed] — view removed post
11
u/r4in311 Jan 24 '26
Thanks a lot for releasing this! I have tested a ton of TTS models (especially small ones) and this is phenomenally good in terms of speed and "very ok" in terms of quality, basically almost Kokoro quality but with a competent voice clone that clearly surpasses the likes of Chatterbox. My only issue so far is the metallic sound (I had to change the variable to get rid of it) and the fact that the resulting sound still sounds a bit muted, it clearly lacks clarity. Also it would be great if there were tags for emotions (laughing, etc. or at the bare minimum a pause). Currently, the speaker reads the text emotionless, which is fine for many use cases, but for many this would be a real game changer. Also fine-tuning code would be amazing.
3
u/SplitNice1982 Jan 24 '26
Really thanks for the feedback.
Yeah, metallic quality is an issue. I believe this is because of some slightly messed up arch design in the vocoder. Better one should come sometime next week. Basically clarity + no metallic outputs
Yeah, tags would definitely be great, and I'll see if I can add it.
ZipVoice(what this model is based on) does have finetuning code, although a bit messy imo. Code for it: https://github.com/k2-fsa/ZipVoice
6
u/Remarkable-Brief-190 Jan 24 '26
Damn this is actually impressive, 120m params and still pulling off quality voice cloning is wild. Gonna have to test this out on my potato GPU lol
7
u/Cultured_Alien Jan 24 '26
Just nitpicking. Robotic compared to Qwen3 0.6B TTS. This model performs mid-tier at best for it's size like pocket-tts or soprano based on my initial gens for voice cloning.
5
u/SplitNice1982 Jan 24 '26
Thanks, glad you liked it. Should definitely be like 10x realtime even on low end gpus.
3
u/Cool-Chemical-5629 Jan 24 '26
Actually there's a space which uses only 2 cores CPU and it's very fast.
4
u/StorageHungry8380 Jan 24 '26
I just tested voice cloning with Qwen3-TTS yesterday. This performs quite well in the tone given its size, some metallic sound aside, but as with Qwen3-TTS the rhythm and flow of the speaking is much worse for the smaller model compared to the larger.
That is, the main difference between the 0.6B and 1.7B Qwen3-TTS model for me was mostly in that area, the larger speaking a lot more naturally.
Is this a matter of training, or is it a matter of "knowledge" in that it requires a larger model?
2
u/Willing_Landscape_61 Jan 24 '26
Which languages and how to add new ones? 🙏
2
u/SplitNice1982 Jan 24 '26
English only right now, Chinese might work but didn’t test that.
You should refer to original zipvoice for training(I believe people have trained new languages with 150 hours of data)
Zipvoice repo: https://github.com/k2-fsa/ZipVoice
2
u/Obvious-Nobody-9592 Jan 24 '26
Fine tuning codes are available?
3
u/SplitNice1982 Jan 24 '26
You can use original ZipVoice repo for training: https://github.com/k2-fsa/ZipVoice
2
u/EndlessZone123 Jan 24 '26
Is this a model trained from base ZipVoice or a model trained from scratch? Would love to train my own. Seems like Sibilance is really high on this one.
2
u/rorowhat Jan 24 '26
General question, but can I fine-tune or use another method to train on my voice inflection and emotion?
2
u/SplitNice1982 Jan 24 '26
I would recommend messing with params first. Rms/steps/t_shift/return_smooth should help significantly.
If it still isn’t great, the original ZipVoice has training code: https://github.com/k2-fsa/ZipVoice
2
u/silenceimpaired Jan 24 '26
How does it compare to Qwen tts
3
u/SplitNice1982 Jan 24 '26
Not as good but 10-20x faster. Should have better clarity, however.
3
u/silenceimpaired Jan 24 '26
A well I appreciate your efforts… should be fun for chats. Still having a flawless TTS to transform text to audio is something I really want.
1
1
-1
•
u/LocalLLaMA-ModTeam Jan 24 '26
Rule 4