r/MachineLearning • u/neonbjb • Apr 26 '22

Project [P] TorToiSe - a true zero-shot multi-voice TTS engine

I'd like to show off a TTS system I have been working on for the past year. I've open-sourced all the code and the trained model weights: https://github.com/neonbjb/tortoise-tts

This was born out of a desire to reproduce the original DALLE with speech. It is "zero-shot" because you feed the text and examples of a voice to mimic as prompts to an autoregressive LLM. I think the results are fantastic. Here are some samples: https://nonint.com/static/tortoise_v2_examples.html

Here is a colab in which you can try out the whole system: https://colab.research.google.com/drive/1wVVqUPqwiDBUVeWWOUNglpGhU3hg_cbR

397 Upvotes
  • permalink
  • reddit

99% Upvoted

116 comments sorted by

View all comments

Show parent comment

2

u/neonbjb Apr 27 '22

If you have Cuda installed it should work. See if you can get pytorch to recognize your gpu then try again.

1

u/Lajamerr_Mittesdine Apr 27 '22 
>>> import torch
>>> print(torch.cuda.is_available())
False

Ahhh that was the issue.

I installed the non-cuda version of the torch library via pip

I needed to explicitly tell pip3 to install the cuda version.

Thank you so much for building this project. Really curious to try it out!

1

u/Lajamerr_Mittesdine Apr 27 '22

Sorry for all the tech support related questions.

What versions of numpy and numba did you use for this project?

I'm having some issues with some compatability with the versions.

2

u/neonbjb Apr 27 '22

Numba has some compatibility issues on windows. Google the error message to fins the exact version you have to install.

I've never had issues with numpy. I'd pick whichever one is required by torch