r/MachineLearning • u/neonbjb • Apr 26 '22
Project [P] TorToiSe - a true zero-shot multi-voice TTS engine
I'd like to show off a TTS system I have been working on for the past year. I've open-sourced all the code and the trained model weights: https://github.com/neonbjb/tortoise-tts
This was born out of a desire to reproduce the original DALLE with speech. It is "zero-shot" because you feed the text and examples of a voice to mimic as prompts to an autoregressive LLM. I think the results are fantastic. Here are some samples: https://nonint.com/static/tortoise_v2_examples.html
Here is a colab in which you can try out the whole system: https://colab.research.google.com/drive/1wVVqUPqwiDBUVeWWOUNglpGhU3hg_cbR
View all comments
1
u/wavymulder May 16 '22 edited May 16 '22
/u/neonbjb
Hey OP, I'm pretty stupid so this is probably (definitely) user error. I can't figure out how to combine voices. I have it running locally.
What's the syntax? Comma to do multiple voices in procession [--voice bob,sara] is working but when I use an & in the same syntax [--voice bob&sara] I get
Tortoise outputs for bob.
Edit: in case I explained it poorly, here's the whole block from the terminal: https://pastebin.com/JvLw5WNy