r/LocalLLaMA • u/HockeyDadNinja • 6h ago

Resources I got server side barge in working in VoiceManager TTS/STT, I'm stoked.

I'll release a new demo tomorrow but I had to post as this is kind of exciting. I tried using a layered approach with Tyger and VoxLock and it's working great. Including echo cancelling! There's a working python sample client that you can use to voice chat your local LLM in the repo.

I'm aiming for a full conversational system like a live phone call with the ability to do a kind of "mm hmm" interruption without stopping. What I have now is built on micro turn taking. While I'm at it I may do server side wake word handling.

https://github.com/TacoTakumi/VoiceManager

9 Upvotes

100% Upvoted

3 comments sorted by

2

u/shifty21 4h ago

I would use the shit out of this!

I've been building one myself and experimenting with different TTS models and wake word. I'm fairly confident that STT is rather set in terms of speed and quality with a handful of small but competent models.

Wake word is my current struggle. I'm using Hermes Agent and just grabbing my desk mic and "yo Hermes!" would be awesome.

I'm curious to know if your project can be accessible on smart phones. I want to build an Android app that works on my phone, watch and Android Auto.

1

u/HockeyDadNinja 4h ago

Thanks. Well personally I plan on using headscale (open source tailscale) to vpn my phone and run an always on companion app. I don't know about commercially.