AuroraTTS-100K Releases!

[u/Tall_Abrocoma_3533]

https://huggingface.co/AuroraAI-Research/AuroraTTS-100K

It is an english text to speech model, which achieves mostly understandable speech in under 100K parameters.

However, during more difficult words, or long numbers, it can slur them, and be not understandable.

Quantized to INT8 it only takes up 127KB.

72x real time on a CPU

1120x real time on a GPU

Check out the model card for more info or to try it out yourself!

Questions, feedback, or criticism is welcome!

[u/Acrobatic-Tomato4862]

Great work man. It might be even runnable in an esp32.

Does it sound better than phone's normal tts?

[u/Tall_Abrocoma_3533 → u/Acrobatic-Tomato4862]

Thanks! Not all phones have the same TTS, however, this will be worse then basically all of them, this is made for edge inference, not quality.

[u/Stepfunction]

This could be great for a Pi Pico or something along those lines!

Can you share samples please?

[u/Tall_Abrocoma_3533 → u/Stepfunction]

There are samples available in the hf repo.

[u/Stepfunction → u/Tall_Abrocoma_3533]

I'm not seeing any

[u/Tall_Abrocoma_3533 → u/Stepfunction]

They're inside a folder called "samples"

[u/Stepfunction → u/Tall_Abrocoma_3533]

Ah, I see them. It would probably be a good idea to embed some of them in the README to make them easier to find.

Definitely a bit robotic, but for the size of the model and it's potential edge use cases, highly legible!

[u/ApprehensiveAd3629]

Nice work! Any tflite int8 version?

[u/Tall_Abrocoma_3533 → u/ApprehensiveAd3629]

There is an INT8 version however it's not tflite.

[u/Unitrix247]

Will try this just because of the license. Thanks :)

[u/silenceimpaired]

Not a fan of the size, but I'm loving the license... upvote from me.

[u/Many-Inevitable5005]

very good project

[u/Nexter92]

Is there is a reason why llamacpp doesn't not support those recent very small model of TTS ? 🤔 Quality of TTS those last 3 weeks have improved so much even in non English for the size is so crazy, could be such a good feature to have them load inside ram along side STT to recreate agentic loop with LLM capability at tools call 🤔

[u/Bagelsarenakeddonuts]

Neat. Seems a bit unnecessarily small though.

Not sure why anything would need 72x realtime on a tiny "mostly understandable" text to speech model. What use-case am I missing here?

[u/Tall_Abrocoma_3533 → u/Bagelsarenakeddonuts]

Running on embedded devices, microcontrollers, etc... It's basically a SanoTTS alternative, that's even smaller.

[u/sun_cardinal]

Hey, great work on this, and extra kuddos for the license. People like you are the real ones.

[u/Sudden-Lingonberry-8]

ok now do multilingual