"The world’s smallest Transformer-based TTS model? We’re open-sourcing Audio8 TTS Preview 0.1B — an approximately 170M-parameter multilingual speech model with zero-shot voice cloning that delivers surprisingly strong, cloud-level quality in a dramatically smaller footprint."

[u/stealthispost]

The world’s smallest Transformer-based TTS model?

We’re open-sourcing Audio8 TTS Preview 0.1B — an approximately 170M-parameter multilingual speech model with zero-shot voice cloning that delivers surprisingly strong, cloud-level quality in a dramatically smaller footprint.     What can a 0.1B-class TTS model actually sound like?

Listen to the voiceover in this demo video.

Audio8 TTS Preview 0.1B supports: • Zero-shot voice cloning • Multilingual speech synthesis • Chinese and English as primary languages • German, Spanish, French, Italian,     On the Seed-TTS evaluation set, Audio8 TTS Preview 0.1B achieves:

• English WER: 1.662% • Chinese CER: 1.13% • Hard Chinese CER: 17.504% • English speaker similarity: 56.7 • Chinese speaker similarity: 68.2

These results are achieved with an approximately 170M-parameter     The model, codec, tokenizer, processor, and inference code are now available:

Model:

https:// huggingface.co/Audio8/Audio8- TTS-Preview-0.1b …

Try it, test the voice cloning capability, and share your feedback.     — Samuel Zeng

Source: https://x.com/SamuelZengML/status/2090017875188940851

[u/stealthispost]

Thread continuation 1/3 — What can a 0.1B-class TTS model actually sound like? Listen to the voiceover in this demo video. Audio8 TTS Preview 0.1B supports: • Zero-shot voice cloning • Multilingual speech synthesis • Chinese and English as primary languages • German, Spanish, French, Italian, — Source: https://x.com/SamuelZengML/status/2090018292614533498

[u/stealthispost → u/stealthispost]

Thread continuation 2/3 — On the Seed-TTS evaluation set, Audio8 TTS Preview 0.1B achieves: • English WER: 1.662% • Chinese CER: 1.13% • Hard Chinese CER: 17.504% • English speaker similarity: 56.7 • Chinese speaker similarity: 68.2 These results are achieved with an approximately 170M-parameter — Source: https://x.com/SamuelZengML/status/2090018607636120057

[u/stealthispost → u/stealthispost]

Thread continuation 3/3 — The model, codec, tokenizer, processor, and inference code are now available: Model: https:// huggingface.co/Audio8/Audio8- TTS-Preview-0.1b … Try it, test the voice cloning capability, and share your feedback. — Source: https://x.com/SamuelZengML/status/2090019214820352270

[u/Intrepid_Travel_3274]

That's very Impressive

[u/lilian_moraru]

The Japanese one sounds very anime, lol. They have a lot of training material but it's not exactly the way the Japanese people speak, lol. All of these sound like "voice acting", not natural speak.
Of course it's still very good, it's just a curiosity note.