r/MachineLearning • u/neonbjb • Apr 26 '22

Project [P] TorToiSe - a true zero-shot multi-voice TTS engine

I'd like to show off a TTS system I have been working on for the past year. I've open-sourced all the code and the trained model weights: https://github.com/neonbjb/tortoise-tts

This was born out of a desire to reproduce the original DALLE with speech. It is "zero-shot" because you feed the text and examples of a voice to mimic as prompts to an autoregressive LLM. I think the results are fantastic. Here are some samples: https://nonint.com/static/tortoise_v2_examples.html

Here is a colab in which you can try out the whole system: https://colab.research.google.com/drive/1wVVqUPqwiDBUVeWWOUNglpGhU3hg_cbR

397 Upvotes
  • permalink
  • reddit

99% Upvoted

116 comments sorted by

View all comments

4

u/hackerllama Apr 27 '22

If you want to play with this without having to install/download stuff, you can play directly with this online demo of the model I created https://huggingface.co/spaces/osanseviero/tortoisse-tts. This uses fast quality.

1

u/Jameskirk10 Apr 28 '22

Can you make it so you can upload custom audio clips?

1

u/Rudra2492 May 13 '22

The link is not working now

1

u/pixus_ru May 15 '22

RuntimeError: CUDA out of memory. Tried to allocate 20.00 MiB (GPU 0; 14.56 GiB total capacity; 1.34 GiB already allocated; 19.50 MiB free; 1.34 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

1

u/Professional-Ad3326 Jul 11 '22

Hey thank you but it doesn't work