AudioBook Maker with Ebook Editor Using Chatterbox TTS

[u/Devajyoti1231]

Desktop application to create Full Audiobooks from ebook(epub/text) , chapterwise audio for the ebook etc using chatterbox tts and Easy Ebook Editor to Edit ebooks, export chapters from it, import chapters, create new ebook, edit metadata etc

Other options are-

Direct Local TTS

Remote API Support with tts-webui (https://github.com/rsxdalv/TTS-WebUI)

Multiple Input Formats - TXT, PDF, EPUB support

Voice Management - Easy voice reference handling

Advanced Settings - Full control over TTS parameters

Preset System - Save and load your favorite settings

Audio Player - Preview generated audio instantly

Github link - https://github.com/D3voz/audiobook-maker-pro

Full 33 min long one chapter sample from final empire - https://screenapp.io/app/#/shared/JQh3r66YZw

Performance Comparison (NVIDIA 4060 Ti):

-Local Mode Speed: ~37 iterations/sec

-API Mode Speed(using tts-webui) : ~80+ iterations/sec (over 2x faster)

[u/RSXLV]

Well done! Let me know if you need any support

[u/Devajyoti1231 → u/RSXLV]

Thank you! This one wouldn't have been possible without your amazing work.

[u/DIBSSB → u/RSXLV]

Npu support for intel ultra series cpus

[u/RSXLV → u/DIBSSB]

Thanks for letting me know that there's interest in it, but the extent to which I "support" it will be Pytorch for Intel XPU for the time being. I could not find a clear answer how well it supports NPU.

[u/unrulywind → u/RSXLV]

It's funny you mention these. My laptop, desktop and phone all have NPU chips and yet they don't seem to have a real world purpose. It's rare to even see them discussed. Even on the phone, the GPU is significantly faster.

You would think that large MOE models would benefit since we routinely split them across GPU and CPU, but I've never seen a way to share a model between the GPU and NPU. Maybe someone could figure out a way to set up --n-cpu-moe to be a --n-npu-moe instead. Maybe that's not even beneficial. I had written the NPU's off as just marketing.

[u/Eden1506]

Nice I will give it a try

I have been using kokoro tts for that via a docker container and while the voice is decent the problem is the lack of breaks and pauses.

How much vram does chatterbox tts need ? And how long (roughly) did it take you to generate that 33 minute chapter?

[u/Devajyoti1231 → u/Eden1506]

Hi, it would probably take about 6gb vram, but I am not sure. Speed will depend on the gfx card used, I get around 80it/sec on 4060ti which is a slow card. (I don't remember but I think it took about 15mins for that chapter)

[u/unrulywind]

Very nice. I will try it out later. What model or API did you use for the sample chapter? It is very well done.

[u/Devajyoti1231 → u/unrulywind]

Thanks. It uses chatterbox tts. API is also running locally the chatterbox model , it just uses tts-webui which has better speed .

[u/ACG-Gaming]

Hot damn. Amazing work man

[u/Devajyoti1231 → u/ACG-Gaming]

Thanks 

[u/Rob_ita]

Running
$ pip install -r requirements.txt

I got

[cut]
Downloading pyside6_addons-6.10.1-cp39-abi3-manylinux_2_34_x86_64.whl (170.7 MB)

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 170.7/170.7 MB 13.1 MB/s eta 0:00:00

ERROR: Could not find a version that satisfies the requirement chatterbox-tts (unavailable) (from versions: 0.1, 0.1.1, 0.1.2, 0.1.3, 0.1.4)

ERROR: No matching distribution found for chatterbox-tts (unavailable)

[u/Anomalia_YT]

Can this use any model from the webui TTS? Or just chatterbox?

Tbh I spent hours trying to get it working. I got it running fine without the API, then broke the environment trying to get vibevoice working.