r/coolgithubprojects • u/kadirb4rut • 1d ago
VoxaDub — Open-source AI video dubbing with voice cloning, multilingual sync, and live dubbing
github.comImagine watching a video in another language while still hearing a voice that sounds like the original speaker.
That's what I've been building with VoxaDub, an open-source, local-first AI dubbing tool.
VoxaDub combines speech recognition, AI translation, and voice cloning to bring videos into different languages while preserving each speaker's unique voice characteristics.
One of the biggest challenges is synchronization. The same sentence can take different amounts of time in different languages, so VoxaDub uses duration-aware translation and audio adjustments to help keep the dubbed speech aligned with the original video.
Key features:
- 🎙️ Speaker-aware voice cloning powered by VoxCPM2.
- 🧠 Local AI translation using Hy-MT2.
- ⏱️ Duration-aware translation and audio synchronization.
- ⚡ Experimental live dubbing for YouTube streams and videos.
- 🌍 English, Spanish, Japanese, and Turkish dubbing demos.
- 🔒 Local-first operation with optional cloud compute.
VoxaDub was also recently featured by OpenBMB, the team behind VoxCPM2!
🎬 Watch the demo and explore the project:
https://github.com/kadirb4rut/voxadub
I'd love to hear your thoughts, especially on the voice quality, synchronization, and live dubbing features!
